-- Logs begin at Mon 2022-07-25 17:50:37 UTC, end at Mon 2022-07-25 19:47:53 UTC. -- Jul 25 18:54:29.930678 dv-cinder-820027-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 18:54:29.940461 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 18:54:29 2022] *** Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: nodename: dv-cinder-820027-16-iscsi Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: machine: x86_64 Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: clock source: unix Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: pcre jit disabled Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: detected number of CPU cores: 4 Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: current working directory: / Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: detected binary path: /usr/bin/uwsgi-core Jul 25 18:54:29.942249 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: your processes number limit is 47680 Jul 25 18:54:29.943239 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: your memory page size is 4096 bytes Jul 25 18:54:29.943239 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: detected max file descriptor number: 2048 Jul 25 18:54:29.943239 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: lock engine: pthread robust mutexes Jul 25 18:54:29.943239 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: thunder lock: enabled Jul 25 18:54:29.943239 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 18:54:29.943239 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 18:54:29.982917 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: Python main interpreter initialized at 0x56198dd509c0 Jul 25 18:54:29.982917 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: python threads support enabled Jul 25 18:54:29.982917 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: your server socket listen backlog is limited to 100 connections Jul 25 18:54:29.982917 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: your mercy for graceful operations on workers is 90 seconds Jul 25 18:54:29.983859 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 18:54:29.983859 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: *** Operational MODE: preforking *** Jul 25 18:54:29.983859 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: *** uWSGI is running in multiple interpreter mode *** Jul 25 18:54:29.983859 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: spawned uWSGI master process (pid: 110252) Jul 25 18:54:29.983869 dv-cinder-820027-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 18:54:29.986368 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: spawned uWSGI worker 1 (pid: 110253, cores: 1) Jul 25 18:54:29.986368 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: spawned uWSGI worker 2 (pid: 110254, cores: 1) Jul 25 18:54:29.986368 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 18:54:30.667633 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 18:54:30.701736 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 18:54:31.796611 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:54:31.796611 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: from cryptography.utils import int_from_bytes Jul 25 18:54:31.797768 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:54:31.797768 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: from cryptography.utils import int_from_bytes Jul 25 18:54:31.809278 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:54:31.809278 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: from cryptography.utils import int_from_bytes Jul 25 18:54:31.809881 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 18:54:31.809881 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: from cryptography.utils import int_from_bytes Jul 25 18:54:34.347619 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 18:54:34.348490 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 18:54:34.348868 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 18:54:34.348975 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 18:54:34.349060 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 18:54:34.349140 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 18:54:34.349228 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 18:54:34.349331 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 18:54:34.349426 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 18:54:34.349510 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 18:54:34.349588 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.349666 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.349751 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.349830 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.349996 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.350106 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.350265 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.350387 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.350621 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.350727 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.350926 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.351021 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.351242 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.351345 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.351555 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.351650 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.351875 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352012 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352132 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352227 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352443 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352572 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352766 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-16-iscsi {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.352854 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-16-iscsi {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353081 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353358 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353451 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353539 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353674 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353760 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.353986 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.354083 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.354286 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.354430 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.354623 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.354717 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.354922 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.355017 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.355418 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.355874 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.355874 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356125 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356251 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356367 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356473 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356577 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356753 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.356887 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357098 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357229 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357355 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357567 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357714 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357842 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.357973 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.358140 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.358274 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.358485 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.358622 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.358788 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.358978 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-16-iscsi {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.359179 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-16-iscsi {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.359309 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.359488 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.359608 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.359794 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.359929 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.360098 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.360289 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.360505 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.360627 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.360810 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.360946 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.361113 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.361242 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.361425 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.361555 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.361752 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.361893 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.362053 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.362179 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.362390 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363075 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363237 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363359 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363553 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363643 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363858 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.363968 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.364167 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.364262 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.364475 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.364567 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.364793 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.364896 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365099 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365186 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365404 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365490 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365650 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365740 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.365933 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366018 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366234 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366320 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366574 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366662 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366889 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.366976 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367139 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367226 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367391 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367478 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367684 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367785 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.367988 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368086 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368303 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368386 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368610 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368746 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368888 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.368977 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.369189 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.369277 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.369488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.369579 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.369906 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370009 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370123 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370211 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370448 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370563 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370746 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.370835 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371057 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371145 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371366 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371463 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371668 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371755 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.371972 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.372106 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.372284 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.372414 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.372609 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.372744 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.372912 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373213 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373351 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373546 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373685 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373850 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.373978 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.374154 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.374291 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.374491 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.374620 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.374795 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.374931 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.375097 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.375234 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.375398 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.375527 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.375699 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.375828 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376012 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376151 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376392 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376519 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376651 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376783 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.376916 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377042 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377174 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377306 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377431 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377554 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377804 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.377946 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.378082 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.378294 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379013 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379152 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379290 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379417 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379541 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379755 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.379885 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380093 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380234 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380368 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380492 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380654 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380838 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.380982 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.381152 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.381276 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.381519 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.381633 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.381825 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.381949 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.382146 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.382267 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.382495 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.382677 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.382907 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.383091 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.383203 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.383394 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.383556 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.383827 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.383971 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384081 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384208 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384332 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384467 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384608 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384751 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.384877 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385001 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385175 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385304 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385474 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385611 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385789 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.385961 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.386100 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.386272 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.386413 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.386601 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.386719 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.386916 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.387045 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.387220 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.387347 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.387522 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.387661 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.387929 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388069 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388194 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388328 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388453 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388576 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388724 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.388864 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389024 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389161 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389322 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389450 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389622 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389750 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.389920 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.390075 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.390238 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.390440 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.390572 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.390696 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.390932 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391073 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391225 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391354 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391533 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391661 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391840 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.391978 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.392160 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.392322 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.392497 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.392698 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.392908 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.393038 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.393160 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.393330 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.393458 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.393771 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 18:54:34.394000 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.394133 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.394279 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.394447 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.394641 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.394782 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395016 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395146 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395315 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395449 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395668 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395803 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.395979 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.396116 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.396288 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.396428 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.396605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.396746 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.396921 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.397057 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.397248 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.397374 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.397561 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.397697 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.397875 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398038 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398257 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398444 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398583 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398724 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398850 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.398982 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.399107 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.399373 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.399514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.399687 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.399817 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400001 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400131 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400345 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400474 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400655 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400793 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.400990 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.401133 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.401381 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.401532 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.401662 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.401787 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.401911 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.402036 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.402199 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.402365 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.402553 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.402703 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.402887 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.403014 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.403197 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.403337 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.403513 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.403641 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.404104 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.404241 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.404375 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.404511 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.404679 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.404881 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405048 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405185 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405360 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405500 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405677 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405806 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.405990 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.406118 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.406296 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.406481 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.406611 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.406736 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.406917 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407047 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407223 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407352 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407528 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407666 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407836 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.407964 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.408143 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.408354 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.408485 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.408618 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.408745 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.408916 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.409069 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.409196 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.409321 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410194 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410369 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410369 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410630 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410630 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410869 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.410993 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411119 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411259 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411386 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411512 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411645 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411772 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.411898 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412031 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412164 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412289 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412421 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412558 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412684 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412817 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.412950 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413076 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413201 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413325 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413448 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413623 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413760 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.413928 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414058 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414278 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414474 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414604 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414729 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414860 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.414988 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.415142 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.415282 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.415445 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.415582 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.415766 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.415895 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416072 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416280 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416409 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416535 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416667 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416793 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.416970 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.417101 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.417272 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.417404 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.417585 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.417714 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.417892 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418022 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418204 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418360 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418567 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418698 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418837 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.418965 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.419140 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.419270 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.419451 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.419587 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.419761 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.419888 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420067 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420196 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420370 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420607 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420747 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420882 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.420992 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421124 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421259 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421394 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421527 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421663 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421828 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.421966 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.422130 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.422276 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.422479 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.422607 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.422762 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.422892 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423069 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423208 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423371 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423501 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423674 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423817 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.423975 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.424104 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.424333 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.424473 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.424599 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.424724 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.424840 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.425497 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.425832 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.425960 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.426213 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.426440 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.426588 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.426716 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.426850 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.426976 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.427168 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.427297 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.427478 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.427608 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.427788 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.427916 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.428098 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.428240 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.428408 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.428554 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.428763 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.428896 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429021 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429153 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429326 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429462 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429635 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429771 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.429939 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.430075 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.430247 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.430439 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.430568 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.430695 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.430872 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431014 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431185 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431320 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431487 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431621 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431800 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.431995 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.432227 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.432359 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.432494 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.432621 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.432755 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.432881 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433036 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433172 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433337 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433464 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433644 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.433971 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.434139 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.434266 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.434498 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.434638 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.434771 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.434906 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435032 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435185 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435321 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435500 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435630 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435801 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.435937 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.436108 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.436245 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.436413 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.436541 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.436713 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.436840 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437023 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437165 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437327 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437470 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437638 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437767 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.437941 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.438083 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.438286 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.438456 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.438629 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.438774 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.438977 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439116 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439242 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439373 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439517 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439642 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439817 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.439939 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.440123 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.440238 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.440431 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.440546 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.441299 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.441484 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.441707 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.441824 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.441940 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442069 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442207 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442365 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442530 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442670 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442831 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.442959 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.443132 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.443264 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.443436 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.443565 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.443745 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.443876 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444049 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444177 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444352 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444509 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444718 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444856 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.444983 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445107 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445232 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445358 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445517 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445728 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445865 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.445992 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.446117 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.446225 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.446431 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.446577 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.446738 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.446853 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447053 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447190 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447375 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447544 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447689 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447816 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.447942 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448091 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448273 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448406 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448558 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448696 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448855 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.448997 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.449217 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.449347 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.449472 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.449605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.449793 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.449926 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.450098 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.450239 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.450418 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.450561 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.450734 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.450863 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451053 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451191 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451356 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451485 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451669 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451806 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.451972 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.452099 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.452276 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.452406 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.452592 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.452734 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.452902 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453205 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453333 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453511 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453653 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453817 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.453938 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.454121 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.454249 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.454482 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.454769 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.454918 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455044 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455167 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455336 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455477 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455639 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455767 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.455939 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.456066 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.456490 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.456645 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.456794 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.456940 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457073 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457197 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457332 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457471 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457609 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457783 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.457921 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.458098 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.458224 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.458439 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.458587 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.458754 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.458883 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459078 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459220 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459430 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459568 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459694 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459826 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.459960 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.460095 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.460252 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.460390 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.460555 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.460685 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.460856 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461053 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461182 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461363 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461500 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461665 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461793 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.461967 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.462096 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.462267 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.462448 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.462599 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.462730 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.462899 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463253 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463383 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463515 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463649 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463773 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.463898 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.464065 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.464203 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.464362 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.464491 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.464668 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.464811 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465155 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465282 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465407 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465558 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465695 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465855 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.465985 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.466151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.466279 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.466504 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.466649 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.466843 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.466973 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.467145 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.467331 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.467475 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.467610 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.467737 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.467861 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468032 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468162 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468342 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468482 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468647 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468777 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.468956 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.469129 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.469336 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.469548 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.469686 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.469813 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470028 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470168 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470309 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470478 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470478 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470717 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470854 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.470987 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471121 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471246 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471378 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471503 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471629 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471766 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.471979 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472109 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472294 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472423 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472547 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472686 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472812 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.472944 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.473101 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.473231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.473404 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.473542 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.473707 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.473835 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474007 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474136 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474312 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474477 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474636 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474767 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.474934 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475145 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475284 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475411 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475544 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475677 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475810 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.475936 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476098 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476228 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476397 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476519 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476693 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476823 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.476995 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.477132 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.477296 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.477432 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.477594 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.477729 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.477942 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.478071 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.478246 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.478412 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.478583 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.478725 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.478886 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479188 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479317 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479489 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479709 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479849 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.479983 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480109 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480218 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480364 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480505 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480662 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480791 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.480963 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.481101 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.481262 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.481401 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.481581 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.481711 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.481886 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482024 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482186 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482316 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482656 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482813 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.482941 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483109 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483237 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483404 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483541 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483701 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483839 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.483999 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.484131 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.484313 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.484449 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.484616 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.484748 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.484911 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485251 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485389 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485514 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485653 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485822 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.485960 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.486118 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.486256 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.486463 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.486605 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.486774 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.486902 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.487076 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.487211 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.487379 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.488031 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.488233 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.488430 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.488545 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.488767 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.488895 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.489080 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.489210 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.489382 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.489520 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.489744 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.489884 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490019 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490153 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490284 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490461 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490590 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490773 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.490911 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.491080 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.491216 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.491388 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.491518 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.491695 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.491825 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492005 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492135 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492316 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492444 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492626 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492762 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.492935 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493064 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493245 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493374 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493551 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493681 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493853 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.493982 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.494156 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.494295 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.494466 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.494590 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.494777 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.494903 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.495112 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.495249 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.495460 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.495590 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.495716 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.495840 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.496002 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.496141 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.496305 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.496433 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.496606 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.496735 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497035 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497171 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497338 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497467 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497648 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497776 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.497978 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498114 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498223 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498370 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498555 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498686 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498861 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.498990 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.499167 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.499295 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.499470 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.499597 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.499892 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500039 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500199 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500332 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500506 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500633 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500817 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.500949 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.501168 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.501335 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.501501 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.501634 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.501770 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.501895 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502021 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502146 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502311 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502493 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502630 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502755 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.502926 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.503056 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.503907 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504050 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504241 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504477 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504596 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504726 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504852 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.504990 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.505116 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.505241 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.505509 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.505649 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.505785 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.505975 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.506107 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.506243 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.506390 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.506598 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.506746 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.506923 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507062 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507239 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507366 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507561 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507698 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507866 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.507995 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.508180 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.508308 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.508489 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.508626 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.508811 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.508939 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.509132 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.509283 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.509487 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.509615 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.509740 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.509874 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.510084 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.510213 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.510459 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.510603 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.510739 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.510866 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511000 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511135 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511270 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511406 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511627 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511756 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.511934 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.512062 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.512462 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.512721 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.512840 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.512968 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513093 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513219 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513357 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513525 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513666 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513792 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.513916 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514047 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514047 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514292 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514446 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514585 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514708 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514832 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.514956 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.515094 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.515262 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.515391 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.515620 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.515761 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.515899 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516035 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516161 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516286 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516452 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516581 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516771 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.516910 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517073 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517202 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517387 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517515 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517693 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517825 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.517998 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.518135 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.518298 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.518480 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.518625 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.518780 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.518915 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519305 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519445 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519581 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519708 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519835 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.519960 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.520107 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.520314 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.520457 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.520584 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.520709 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.520835 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521005 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521152 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521319 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521448 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521623 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521753 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.521920 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.522058 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.522216 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.522370 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.522536 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.522665 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.522870 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523014 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523168 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523297 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523484 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523612 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523807 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.523948 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.524121 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.524248 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.524424 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.524562 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.524709 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.524835 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525017 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525146 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525320 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525455 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525628 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525837 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.525966 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526099 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526226 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526398 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526537 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526668 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526850 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.526979 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.527156 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.527285 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.527468 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.527597 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.527770 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.527899 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.528070 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.528208 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.528372 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.528500 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.528924 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529064 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529227 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529364 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529545 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529676 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529845 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.529974 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.530163 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.530317 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.530527 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.530657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.530781 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.530918 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.531072 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.531211 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.531371 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.531500 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.531707 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.531837 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532004 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532135 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532334 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532464 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532646 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532780 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.532959 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.533088 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.533289 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.533417 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.533571 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.533705 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.533914 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.534055 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.534173 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.534294 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.535209 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.535353 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.535492 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.535620 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.535744 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.535961 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536161 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536301 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536429 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536556 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536853 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.536984 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.537168 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.537298 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.537475 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.537611 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.537788 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.537914 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.538131 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.538349 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.538483 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.538723 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.538851 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539035 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539175 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539347 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539474 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539656 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539788 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.539966 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.540096 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.540275 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.540403 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.540615 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.540762 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.540898 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541032 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541158 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541283 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541466 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541604 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541769 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.541908 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.542089 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.542231 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.542442 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.542587 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.542759 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.542888 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543073 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543201 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543383 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543522 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543690 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543818 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.543996 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.544123 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.544303 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.544431 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.544616 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.544745 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.544925 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545046 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545230 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545358 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545538 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545666 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545845 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.545996 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.546191 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.546386 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.546515 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.546641 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.546766 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.546905 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547033 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547159 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547381 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547523 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547649 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547784 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.547940 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.548214 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.548956 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549086 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549223 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549351 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549485 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549615 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549749 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.549749 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.550045 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.550724 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.550956 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.550956 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551195 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551322 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551322 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551576 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551702 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551827 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.551952 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552076 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552215 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552343 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552468 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552623 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552754 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.552942 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.553079 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.553256 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.553386 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.553579 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.553708 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.553882 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.554013 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.554184 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.554435 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.554598 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.554788 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.554934 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.555104 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.555232 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.555418 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.555546 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.555724 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.555867 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556022 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556152 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556369 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556500 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556633 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556766 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.556937 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.557132 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.557260 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.557474 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.557612 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.557786 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.557915 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.558105 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.558233 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.558437 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.558580 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.558750 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.558877 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559052 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559178 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559353 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559488 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559659 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559786 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.559959 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.560086 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.560267 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.560394 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.560570 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.560701 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.560872 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561076 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561215 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561341 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561473 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561607 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561735 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.561844 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562030 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562161 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562349 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562480 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562648 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562777 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.562956 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563086 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563255 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563382 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563553 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563693 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563851 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.563980 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.564154 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.564283 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.564451 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.564589 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.564748 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.564877 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565046 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565175 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565342 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565482 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565669 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565806 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.565967 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.566105 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.566300 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.566464 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.566633 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.566762 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.566954 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.567088 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.567292 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.567419 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.567541 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.567672 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.567873 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.568002 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.568187 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.568315 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.568484 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.568723 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.568851 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569065 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569240 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569369 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569492 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569666 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569796 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.569972 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.570110 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.570276 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.570465 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.570641 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.570770 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.570948 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.571091 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.571293 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.571474 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.571604 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.571805 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.571944 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.572121 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.572258 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.572450 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.572578 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.572757 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.572894 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573066 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573204 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573365 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573493 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573666 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573796 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.573971 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.574098 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.574278 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.574426 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.574608 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.574747 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.574914 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575042 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575223 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575392 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575520 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575649 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575817 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.575992 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.576128 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.576265 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.576414 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.576553 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.576703 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.576834 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577073 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577210 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577382 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577510 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577686 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577814 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.577994 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.578131 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.578301 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.578510 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.578639 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.578764 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.578962 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.579102 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.579275 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.579404 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.579580 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.579714 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.579889 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580017 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580196 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580324 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580502 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580632 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580808 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.580937 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.581113 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.581296 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.581504 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.581643 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.581886 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.582025 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.582200 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.582407 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.582540 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.582734 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.582939 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.583128 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.583320 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.583515 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.583708 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.583914 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.584105 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.584300 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.584490 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.584684 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.584897 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.585104 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.585300 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.585510 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.585719 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.585919 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.586126 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.586310 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.586507 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.586651 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.586784 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.586983 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587149 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587288 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587415 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587541 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587672 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587803 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.587943 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588070 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588197 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588338 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588463 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588598 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588762 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.588894 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589036 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589171 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589298 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589437 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589572 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589706 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589833 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.589958 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590084 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590218 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590372 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590512 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590640 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590775 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.590910 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591045 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591173 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591305 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591431 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591688 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591848 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.591978 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592110 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592257 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592387 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592529 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592669 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592805 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.592933 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593058 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593184 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593308 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593446 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593609 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593750 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.593878 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594022 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594151 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594288 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594484 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594613 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594739 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594864 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.594864 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595111 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595111 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595332 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595456 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595582 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595582 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.595895 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596028 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596163 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596291 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596417 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596556 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596683 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.596797 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.597464 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.597672 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.597888 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.598032 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.598209 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.598383 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.598634 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.598765 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.598899 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599026 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599318 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599447 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599641 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599787 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.599963 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.600092 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.600279 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.600415 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.600592 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.600735 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.600922 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.601052 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.601251 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.601379 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.601549 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.601699 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.601918 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602056 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602183 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602308 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602567 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602696 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602829 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.602954 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603087 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603219 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603364 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603491 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603649 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603779 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.603954 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.604091 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.604261 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.604390 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.604568 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.604705 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.604875 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605014 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605184 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605314 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605491 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605621 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605797 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.605944 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.606108 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.606246 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.606442 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.606572 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.606767 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.606909 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607087 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607217 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607393 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607521 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607713 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607842 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.607958 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 18:54:34.608083 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.608369 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.608678 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.609018 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.609340 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.609651 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.609959 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.610258 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 18:54:34.610525 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 18:54:34.769138 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO dbcounter [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Registered counter for database nova_api Jul 25 18:54:34.769778 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO dbcounter [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Registered counter for database nova_api Jul 25 18:54:34.790738 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_db.sqlalchemy.engines [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:34.792540 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_db.sqlalchemy.engines [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:34.800698 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writer thread running {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:34.800924 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writer thread running {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:34.857322 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.context [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04f7c03e-eb8a-4b91-bf46-eb25d497e920(cell1) {{(pid=110253) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 18:54:34.858275 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.context [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04f7c03e-eb8a-4b91-bf46-eb25d497e920(cell1) {{(pid=110254) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 18:54:34.861445 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 18:54:34.862502 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_concurrency.lockutils [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 18:54:34.863635 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 18:54:34.864613 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 18:54:34.864870 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_concurrency.lockutils [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 18:54:34.865670 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_concurrency.lockutils [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 18:54:34.866612 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 18:54:34.867747 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_concurrency.lockutils [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 18:54:34.868583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO dbcounter [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Registered counter for database nova_cell0 Jul 25 18:54:34.869758 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO dbcounter [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Registered counter for database nova_cell0 Jul 25 18:54:34.874521 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO dbcounter [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Registered counter for database nova_cell1 Jul 25 18:54:34.875812 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO dbcounter [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Registered counter for database nova_cell1 Jul 25 18:54:34.881838 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_db.sqlalchemy.engines [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:34.883964 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_db.sqlalchemy.engines [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:34.885884 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_db.sqlalchemy.engines [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:34.887730 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_db.sqlalchemy.engines [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:34.889222 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writer thread running {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:34.892594 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writer thread running {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:34.895847 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writer thread running {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:35.036282 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writer thread running {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:35.045485 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO dbcounter [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Registered counter for database nova_cell0 Jul 25 18:54:35.046368 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO dbcounter [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Registered counter for database nova_cell0 Jul 25 18:54:35.053398 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_db.sqlalchemy.engines [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:35.054727 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG oslo_db.sqlalchemy.engines [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 18:54:35.058068 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writer thread running {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:35.059549 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writer thread running {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 18:54:35.479505 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: WARNING keystonemiddleware.auth_token [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 18:54:35.486793 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: WARNING keystonemiddleware.auth_token [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 18:54:35.517929 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: WARNING keystonemiddleware.auth_token [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 18:54:35.528470 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: WARNING keystonemiddleware.auth_token [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 18:54:35.833691 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: WARNING keystonemiddleware.auth_token [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 18:54:35.839649 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: WARNING keystonemiddleware.auth_token [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 18:54:35.844924 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56198dd509c0 pid: 110253 (default app) Jul 25 18:54:35.847832 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:54:35.849181 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002578 Jul 25 18:54:35.849721 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Mon Jul 25 18:54:35 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:54:35.875483 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: WARNING keystonemiddleware.auth_token [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 18:54:35.881818 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: WARNING keystonemiddleware.auth_token [None req-84d99a27-335e-4590-a09a-1f8c3986763a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 18:54:35.887460 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56198dd509c0 pid: 110254 (default app) Jul 25 18:55:59.278097 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:55:59.280122 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.015623 Jul 25 18:55:59.282380 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:55:59.294967 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writing DB stats nova_api:SELECT=3 {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:59.295981 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writing DB stats nova_cell0:SELECT=3 {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:59.297352 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writing DB stats nova_cell1:SELECT=3 {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:55:59.298533 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:00.273766 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-62371387-fcf5-4cd7-a23b-f5d89f5b4e49 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:00.307897 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-62371387-fcf5-4cd7-a23b-f5d89f5b4e49 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.018841 Jul 25 18:56:00.308563 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 18:55:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:02.593054 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:02.594164 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-8678b472-aa72-4c23-93ad-d3e56ba5e178 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Jul 25 18:56:02.598256 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:02 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:03.114269 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-6966f8fd-374f-4470-ab48-af7e36a89518 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "id": "c1", "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:03.135591 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 18:56:03.135591 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: warnings.warn(msg) Jul 25 18:56:03.231027 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-6966f8fd-374f-4470-ab48-af7e36a89518 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.629817 Jul 25 18:56:03.231809 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:03.252707 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_api:SELECT=3 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:03.252707 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_cell0:SELECT=3 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:03.252707 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_cell1:SELECT=3 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:03.252707 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:03.466643 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-b447b36f-8770-4052-bd2a-047124771adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:03.471832 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 18:56:03.471832 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: warnings.warn(msg) Jul 25 18:56:03.595422 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-b447b36f-8770-4052-bd2a-047124771adf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.354703 Jul 25 18:56:03.596470 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 18:56:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:05.903650 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-6966f8fd-374f-4470-ab48-af7e36a89518 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:05.904731 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-6966f8fd-374f-4470-ab48-af7e36a89518 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jul 25 18:56:05.905402 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:06.681383 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-25f1f500-1ead-4ae2-aa92-ffbf3bf998b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "ram": 512, "disk": 5, "id": "d1", "rxtx_factor": 1.0}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:06.700771 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 18:56:06.700771 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: warnings.warn(msg) Jul 25 18:56:06.804484 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-25f1f500-1ead-4ae2-aa92-ffbf3bf998b4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.891813 Jul 25 18:56:06.805057 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:06.817487 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-e85ce267-1bdc-4dc3-9827-26615d78ff66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:06.820541 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 18:56:06.820541 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: warnings.warn(msg) Jul 25 18:56:06.951101 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-e85ce267-1bdc-4dc3-9827-26615d78ff66 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137303 Jul 25 18:56:06.962935 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 18:56:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:09.225218 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-25f1f500-1ead-4ae2-aa92-ffbf3bf998b4 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:09.226684 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-25f1f500-1ead-4ae2-aa92-ffbf3bf998b4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002886 Jul 25 18:56:09.227231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:09.665171 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-6df4853e-86ea-45fa-bcc5-13073917038e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "swap": 0}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:09.762740 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-6df4853e-86ea-45fa-bcc5-13073917038e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528512 Jul 25 18:56:09.763452 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:09.776450 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-587f1441-5736-456e-afc7-09d3ed13d94e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:09.881926 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-587f1441-5736-456e-afc7-09d3ed13d94e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109669 Jul 25 18:56:09.882575 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 18:56:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:12.187192 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-6df4853e-86ea-45fa-bcc5-13073917038e admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:12.188150 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-6df4853e-86ea-45fa-bcc5-13073917038e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Jul 25 18:56:12.189055 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:12.667230 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-2d6167e5-963b-459b-ab2a-0ab0f3fb4621 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:12.791607 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-2d6167e5-963b-459b-ab2a-0ab0f3fb4621 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.596100 Jul 25 18:56:12.798386 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 18:56:12.806631 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-9e5c629d-acba-4d8a-80c0-edd01a1f3822 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:12.962542 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-9e5c629d-acba-4d8a-80c0-edd01a1f3822 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159726 Jul 25 18:56:12.963608 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 18:56:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:15.290278 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-2d6167e5-963b-459b-ab2a-0ab0f3fb4621 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:15.291320 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-2d6167e5-963b-459b-ab2a-0ab0f3fb4621 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 25 18:56:15.291728 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:15.837895 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-e8af1075-5eda-4f7b-80ca-2c0589ae4115 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:15.929667 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-e8af1075-5eda-4f7b-80ca-2c0589ae4115 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.630319 Jul 25 18:56:15.938414 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:15.944404 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-ab764c5d-94fe-4c30-83a4-b75f02aec32b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:16.030149 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-ab764c5d-94fe-4c30-83a4-b75f02aec32b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090299 Jul 25 18:56:16.030905 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Jul 25 18:56:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:18.430810 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-e8af1075-5eda-4f7b-80ca-2c0589ae4115 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:18.431837 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-e8af1075-5eda-4f7b-80ca-2c0589ae4115 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 25 18:56:18.432246 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:18.941077 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-b8beb057-ec62-429c-b6e5-94a4ab0b8082 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:18.972032 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-b8beb057-ec62-429c-b6e5-94a4ab0b8082 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.532064 Jul 25 18:56:18.972586 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 18:56:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 18:56:21.300280 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-e8af1075-5eda-4f7b-80ca-2c0589ae4115 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:21.301897 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-e8af1075-5eda-4f7b-80ca-2c0589ae4115 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Jul 25 18:56:21.302648 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:21.848278 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-01bfdbef-b2b0-4685-b8ab-b8d6c4fec893 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "swap": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:21.931603 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-01bfdbef-b2b0-4685-b8ab-b8d6c4fec893 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.622626 Jul 25 18:56:21.932328 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:21.947536 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-6767f4dc-6b11-4102-9265-8426a7bfe12c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:22.036300 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-6767f4dc-6b11-4102-9265-8426a7bfe12c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092526 Jul 25 18:56:22.037021 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 18:56:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 18:56:24.459218 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-01bfdbef-b2b0-4685-b8ab-b8d6c4fec893 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:24.460347 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-01bfdbef-b2b0-4685-b8ab-b8d6c4fec893 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 25 18:56:24.460757 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:24.961706 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5c1914b7-71a6-4e8f-9196-cb99e8823808 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "rxtx_factor": 1.0, "disk": 20, "name": "m1.small"}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:25.058749 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5c1914b7-71a6-4e8f-9196-cb99e8823808 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.591124 Jul 25 18:56:25.059238 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:25.079806 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-e4e6bcef-b4d8-48e9-a48f-8d9618b16f02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:25.170211 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-e4e6bcef-b4d8-48e9-a48f-8d9618b16f02 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096382 Jul 25 18:56:25.171727 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 18:56:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:27.517035 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5c1914b7-71a6-4e8f-9196-cb99e8823808 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:27.518044 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5c1914b7-71a6-4e8f-9196-cb99e8823808 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 25 18:56:27.518698 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:27.898139 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-e275def6-9837-4c9a-94a6-715fa45dca16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:27.975298 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-e275def6-9837-4c9a-94a6-715fa45dca16 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449697 Jul 25 18:56:27.977052 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:27.988554 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-4122e7a1-4089-48e7-979e-55b05e60bf2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:28.080370 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-4122e7a1-4089-48e7-979e-55b05e60bf2a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095632 Jul 25 18:56:28.080949 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 18:56:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:30.571359 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-e275def6-9837-4c9a-94a6-715fa45dca16 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:30.572555 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-e275def6-9837-4c9a-94a6-715fa45dca16 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Jul 25 18:56:30.573149 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 18:56:31.106529 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-f6d48633-65a4-4dbe-a5ac-cd5925ab7325 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:31.114312 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:31.243778 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-f6d48633-65a4-4dbe-a5ac-cd5925ab7325 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.664256 Jul 25 18:56:31.244469 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:56:31.258031 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-38d58116-cae0-4baa-8103-f543ae40dfe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:31.349508 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-38d58116-cae0-4baa-8103-f543ae40dfe2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095061 Jul 25 18:56:31.362357 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 18:56:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:33.657399 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-f6d48633-65a4-4dbe-a5ac-cd5925ab7325 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:33.658474 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-f6d48633-65a4-4dbe-a5ac-cd5925ab7325 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 25 18:56:33.658937 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:34.175532 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-f9de2c44-268e-4091-bc5d-99b2e0813d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge"}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:34.312310 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-f9de2c44-268e-4091-bc5d-99b2e0813d6a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.646648 Jul 25 18:56:34.313074 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Jul 25 18:56:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 18:56:34.331380 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-f4c44bea-4e79-4554-9a6c-14e577bee485 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:56:34.460035 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-f4c44bea-4e79-4554-9a6c-14e577bee485 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131777 Jul 25 18:56:34.474993 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Jul 25 18:56:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:56:55.218387 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-f9de2c44-268e-4091-bc5d-99b2e0813d6a admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:55.219400 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-f9de2c44-268e-4091-bc5d-99b2e0813d6a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 25 18:56:55.219807 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:55.642827 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-88bd8df4-d455-4dac-b237-b2ddaffa77dc admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:55.662914 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-88bd8df4-d455-4dac-b237-b2ddaffa77dc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436529 Jul 25 18:56:55.663559 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 18:56:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 18:56:56.775470 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-f9de2c44-268e-4091-bc5d-99b2e0813d6a admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:56.776473 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-f9de2c44-268e-4091-bc5d-99b2e0813d6a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 25 18:56:56.776870 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:57.367990 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-8ffbf6f4-3d1f-4219-b8ef-bd7b06b99f0f admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:57.374634 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.wsgi [None req-8ffbf6f4-3d1f-4219-b8ef-bd7b06b99f0f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-8ffbf6f4-3d1f-4219-b8ef-bd7b06b99f0f admin admin] Request method failure captured: Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Accept: application/json Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Accept-Encoding: gzip, deflate Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Connection: keep-alive Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Content-Length: 0 Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Host: 10.222.0.17 Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Openstack-Api-Version: compute 2.90 Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Openstack-System-Scope: None Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: User-Agent: python-novaclient Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Auth-Token: gAAAAABi3ud4C6i8FsyKZZHwU1_YvUYqQb9OY2EQ4wlvldZ597kCM75_RmQqrNOFlRwYhZHY-nVbYR3sRDutq53Zo4JLKZkJJy3Pz135ZFxInrfVlJKOKgvF5j3VTHHntH0kYXGIyAPrd3dWvMNP6Qpl_hg5w9QCwtGHjgUSX3SBYXoJ-ER35pY Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Domain-Id: None Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Domain-Name: None Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Identity-Status: Confirmed Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Is-Admin-Project: True Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Domain-Id: default Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Domain-Name: Default Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Name: admin Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Role: admin,member,reader Jul 25 18:56:57.377852 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Roles: admin,member,reader Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39adca8a83c49e4a2ab45e68b3a9724", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant: admin Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant-Name: admin Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User: admin Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Domain-Id: default Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Domain-Name: Default Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Id: 4a0aec528900484294cd86eb90b642f7 Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Name: admin Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: method: > Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: exception: Flavor 42 could not be found. Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: action_args: {'id': '42'} Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 18:56:57.379488 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:57.380590 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.382356 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-8ffbf6f4-3d1f-4219-b8ef-bd7b06b99f0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 18:56:57.383681 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-8ffbf6f4-3d1f-4219-b8ef-bd7b06b99f0f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.457294 Jul 25 18:56:57.383681 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 18:56:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 18:56:57.389233 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-fc9d652c-fbc6-4024-b1c1-e0b8140aac56 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:57.393843 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:56:57.413489 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-fc9d652c-fbc6-4024-b1c1-e0b8140aac56 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027787 Jul 25 18:56:57.414123 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 18:56:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 18:56:57.425115 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-8852635e-0dfc-4aac-863c-97d4d1ccee1d admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:57.450166 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-8852635e-0dfc-4aac-863c-97d4d1ccee1d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028694 Jul 25 18:56:57.450825 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 18:56:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 18:56:57.460696 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-9f09ad98-48e1-475a-9c7a-b43a2c2a4aea admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:57.467475 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.wsgi [None req-9f09ad98-48e1-475a-9c7a-b43a2c2a4aea admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-9f09ad98-48e1-475a-9c7a-b43a2c2a4aea admin admin] Request method failure captured: Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Accept: application/json Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Accept-Encoding: gzip, deflate Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Connection: keep-alive Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Content-Length: 0 Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Host: 10.222.0.17 Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Openstack-Api-Version: compute 2.90 Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Openstack-System-Scope: None Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: User-Agent: python-novaclient Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Auth-Token: gAAAAABi3ud4C6i8FsyKZZHwU1_YvUYqQb9OY2EQ4wlvldZ597kCM75_RmQqrNOFlRwYhZHY-nVbYR3sRDutq53Zo4JLKZkJJy3Pz135ZFxInrfVlJKOKgvF5j3VTHHntH0kYXGIyAPrd3dWvMNP6Qpl_hg5w9QCwtGHjgUSX3SBYXoJ-ER35pY Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Domain-Id: None Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Domain-Name: None Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Identity-Status: Confirmed Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Is-Admin-Project: True Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Domain-Id: default Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Domain-Name: Default Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Name: admin Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Role: admin,member,reader Jul 25 18:56:57.470765 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Roles: admin,member,reader Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39adca8a83c49e4a2ab45e68b3a9724", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant: admin Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant-Name: admin Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User: admin Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Domain-Id: default Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Domain-Name: Default Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Id: 4a0aec528900484294cd86eb90b642f7 Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Name: admin Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: method: > Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: exception: Flavor 42 could not be found. Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: action_args: {'id': '42'} Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 18:56:57.472557 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:57.473496 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:57.474850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-9f09ad98-48e1-475a-9c7a-b43a2c2a4aea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 18:56:57.484166 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-9f09ad98-48e1-475a-9c7a-b43a2c2a4aea admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015408 Jul 25 18:56:57.484166 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 18:56:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 18:56:58.534256 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-8852635e-0dfc-4aac-863c-97d4d1ccee1d admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:58.535289 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-8852635e-0dfc-4aac-863c-97d4d1ccee1d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 25 18:56:58.535695 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:56:59.098384 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-b390adb4-6bf9-47d5-bed6-1ed62d5243eb admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:59.103740 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.wsgi [None req-b390adb4-6bf9-47d5-bed6-1ed62d5243eb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-b390adb4-6bf9-47d5-bed6-1ed62d5243eb admin admin] Request method failure captured: Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Accept: application/json Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Accept-Encoding: gzip, deflate Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Connection: keep-alive Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Content-Length: 0 Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Host: 10.222.0.17 Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Openstack-Api-Version: compute 2.90 Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Openstack-System-Scope: None Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: User-Agent: python-novaclient Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Auth-Token: gAAAAABi3ud6hB_CQyFszIZeE0cc-ynBbMRzCmMMFbPZnM_xfz2a_77EpTe4eqWDWDSJXEZzMDQyLqMYvuSPGEnL6K0xGXxT8QPuarijdsIoHqZ9ag-SrrnSi6ifVa10ItUKhTXOQJwCs7kdrnQpFiHb3FuPbSYxH7NiJ9EW29PU5uOx0OevNis Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Domain-Id: None Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Domain-Name: None Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Identity-Status: Confirmed Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Is-Admin-Project: True Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Domain-Id: default Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Domain-Name: Default Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Name: admin Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Role: admin,member,reader Jul 25 18:56:59.105231 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Roles: admin,member,reader Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39adca8a83c49e4a2ab45e68b3a9724", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant: admin Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant-Name: admin Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User: admin Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Domain-Id: default Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Domain-Name: Default Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Id: 4a0aec528900484294cd86eb90b642f7 Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Name: admin Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: method: > Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: exception: Flavor 84 could not be found. Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: action_args: {'id': '84'} Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 18:56:59.106583 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:59.107812 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.109017 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-b390adb4-6bf9-47d5-bed6-1ed62d5243eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 18:56:59.110042 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-b390adb4-6bf9-47d5-bed6-1ed62d5243eb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.414832 Jul 25 18:56:59.110042 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 18:56:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 18:56:59.116455 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-99512413-0d4c-4ac0-a0a9-895ec3f5c67a admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:59.132193 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-99512413-0d4c-4ac0-a0a9-895ec3f5c67a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019243 Jul 25 18:56:59.132741 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 18:56:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 18:56:59.143347 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-63df3daa-8cbf-4f4f-bcfe-0cc37c5c5f4b admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:59.159134 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-63df3daa-8cbf-4f4f-bcfe-0cc37c5c5f4b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019297 Jul 25 18:56:59.159691 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 18:56:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 18:56:59.169341 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-85c9bbb4-9c6f-4cc4-9831-ea7349088a81 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:56:59.177664 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.wsgi [None req-85c9bbb4-9c6f-4cc4-9831-ea7349088a81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-85c9bbb4-9c6f-4cc4-9831-ea7349088a81 admin admin] Request method failure captured: Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Accept: application/json Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Accept-Encoding: gzip, deflate Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Connection: keep-alive Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Content-Length: 0 Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Host: 10.222.0.17 Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Openstack-Api-Version: compute 2.90 Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Openstack-System-Scope: None Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: User-Agent: python-novaclient Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Auth-Token: gAAAAABi3ud6hB_CQyFszIZeE0cc-ynBbMRzCmMMFbPZnM_xfz2a_77EpTe4eqWDWDSJXEZzMDQyLqMYvuSPGEnL6K0xGXxT8QPuarijdsIoHqZ9ag-SrrnSi6ifVa10ItUKhTXOQJwCs7kdrnQpFiHb3FuPbSYxH7NiJ9EW29PU5uOx0OevNis Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Domain-Id: None Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Domain-Name: None Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Identity-Status: Confirmed Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Is-Admin-Project: True Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Domain-Id: default Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Domain-Name: Default Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Name: admin Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Role: admin,member,reader Jul 25 18:56:59.179514 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Roles: admin,member,reader Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39adca8a83c49e4a2ab45e68b3a9724", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant: admin Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant-Name: admin Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User: admin Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Domain-Id: default Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Domain-Name: Default Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Id: 4a0aec528900484294cd86eb90b642f7 Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Name: admin Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: method: > Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: exception: Flavor 84 could not be found. Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: action_args: {'id': '84'} Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 18:56:59.181042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:59.181998 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:56:59.183573 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-85c9bbb4-9c6f-4cc4-9831-ea7349088a81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 18:56:59.185502 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-85c9bbb4-9c6f-4cc4-9831-ea7349088a81 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015389 Jul 25 18:56:59.185502 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Jul 25 18:56:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 18:57:00.266320 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-63df3daa-8cbf-4f4f-bcfe-0cc37c5c5f4b admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:00.267833 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-63df3daa-8cbf-4f4f-bcfe-0cc37c5c5f4b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001847 Jul 25 18:57:00.268297 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:57:00.821385 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-3e108c9e-1681-4e2f-bb2c-d6ce8f8e8471 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:00.828285 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.wsgi [None req-3e108c9e-1681-4e2f-bb2c-d6ce8f8e8471 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-3e108c9e-1681-4e2f-bb2c-d6ce8f8e8471 admin admin] Request method failure captured: Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Accept: application/json Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Accept-Encoding: gzip, deflate Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Connection: keep-alive Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Content-Length: 0 Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Host: 10.222.0.17 Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Openstack-Api-Version: compute 2.90 Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Openstack-System-Scope: None Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: User-Agent: python-novaclient Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Auth-Token: gAAAAABi3ud8smyHlHySM6VXhLsTUtvgWHL0TDg5Yyodr3UspKmmK4AlvRaHT8RIGPPT3Xnx8LCy1d9bKJ2jMeLQUEIzQxnQnRVZ5brPl2doDCS2NRFySf2yEu28Mt2wVi5HlZnn9D6vh9GCVCzMxC3rS4xJsj5fKw7FHNSzcfJKgzUy3E3fh5Q Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Domain-Id: None Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Domain-Name: None Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Identity-Status: Confirmed Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Is-Admin-Project: True Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Domain-Id: default Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Domain-Name: Default Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Project-Name: admin Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Role: admin,member,reader Jul 25 18:57:00.833039 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Roles: admin,member,reader Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39adca8a83c49e4a2ab45e68b3a9724", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant: admin Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-Tenant-Name: admin Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User: admin Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Domain-Id: default Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Domain-Name: Default Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Id: 4a0aec528900484294cd86eb90b642f7 Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: X-User-Name: admin Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: method: > Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: exception: Flavor 451 could not be found. Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: action_args: {'id': '451'} Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 18:57:00.834657 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:57:00.835605 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.836848 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-3e108c9e-1681-4e2f-bb2c-d6ce8f8e8471 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 18:57:00.838028 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-3e108c9e-1681-4e2f-bb2c-d6ce8f8e8471 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.418319 Jul 25 18:57:00.838028 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 18:57:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 18:57:00.841827 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-7b8f4ba4-d9b1-4068-8f9a-60846385d159 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:00.857301 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-7b8f4ba4-d9b1-4068-8f9a-60846385d159 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019646 Jul 25 18:57:00.857906 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 18:57:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 18:57:00.868273 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:00.884058 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019248 Jul 25 18:57:00.884725 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Jul 25 18:57:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 18:57:00.895175 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-a528f12f-72bd-4164-b3a9-6bf42be0ce88 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:00.901043 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.wsgi [None req-a528f12f-72bd-4164-b3a9-6bf42be0ce88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-a528f12f-72bd-4164-b3a9-6bf42be0ce88 admin admin] Request method failure captured: Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Accept: application/json Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Accept-Encoding: gzip, deflate Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Connection: keep-alive Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Content-Length: 0 Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Host: 10.222.0.17 Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Openstack-Api-Version: compute 2.90 Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Openstack-System-Scope: None Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: User-Agent: python-novaclient Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Auth-Token: gAAAAABi3ud8smyHlHySM6VXhLsTUtvgWHL0TDg5Yyodr3UspKmmK4AlvRaHT8RIGPPT3Xnx8LCy1d9bKJ2jMeLQUEIzQxnQnRVZ5brPl2doDCS2NRFySf2yEu28Mt2wVi5HlZnn9D6vh9GCVCzMxC3rS4xJsj5fKw7FHNSzcfJKgzUy3E3fh5Q Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Domain-Id: None Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Domain-Name: None Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Identity-Status: Confirmed Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Is-Admin-Project: True Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Domain-Id: default Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Domain-Name: Default Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Project-Name: admin Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Role: admin,member,reader Jul 25 18:57:00.902681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Roles: admin,member,reader Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39adca8a83c49e4a2ab45e68b3a9724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39adca8a83c49e4a2ab45e68b3a9724", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant: admin Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant-Id: c39adca8a83c49e4a2ab45e68b3a9724 Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-Tenant-Name: admin Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User: admin Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Domain-Id: default Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Domain-Name: Default Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Id: 4a0aec528900484294cd86eb90b642f7 Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: X-User-Name: admin Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: method: > Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: exception: Flavor 451 could not be found. Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: action_args: {'id': '451'} Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 18:57:00.904151 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:57:00.904923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: ERROR nova.api.openstack.wsgi Jul 25 18:57:00.905937 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-a528f12f-72bd-4164-b3a9-6bf42be0ce88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 18:57:00.906946 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-a528f12f-72bd-4164-b3a9-6bf42be0ce88 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012797 Jul 25 18:57:00.906946 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 18:57:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 18:57:01.932028 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:01.933042 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 25 18:57:01.933437 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:57:02.487703 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-bb8b2733-679d-47a2-b7ad-f0925dd04df1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:57:02.567541 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-bb8b2733-679d-47a2-b7ad-f0925dd04df1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.492357 Jul 25 18:57:02.568087 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 18:57:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:57:03.599781 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:03.600803 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 25 18:57:03.601236 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:57:04.153141 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-040e5cc3-f117-4b2f-ae9f-2b63f94ac430 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:57:04.229574 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-040e5cc3-f117-4b2f-ae9f-2b63f94ac430 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.484938 Jul 25 18:57:04.230146 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 18:57:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:57:05.246698 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:05.248223 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Jul 25 18:57:05.248616 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:57:05.803454 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-6fa5e8bf-de58-4569-920d-aa6b4d508c10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:57:05.955463 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-6fa5e8bf-de58-4569-920d-aa6b4d508c10 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.564729 Jul 25 18:57:05.956022 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 18:57:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:57:06.967570 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:06.968571 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 25 18:57:06.968974 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:57:07.564424 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-9e6a009a-fc05-4f9e-a686-00b7811a3382 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 18:57:07.634965 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-9e6a009a-fc05-4f9e-a686-00b7811a3382 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.519736 Jul 25 18:57:07.635503 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Jul 25 18:57:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 18:57:08.689515 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:08.690570 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 25 18:57:08.690975 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 18:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:57:09.277463 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-be4686c8-de08-4b58-b9e5-ce0bb0f6dc06 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:57:09.299361 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-be4686c8-de08-4b58-b9e5-ce0bb0f6dc06 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450143 Jul 25 18:57:09.299906 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Mon Jul 25 18:57:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 18:58:06.177184 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:58:06.177184 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-17f42342-34cc-40c7-821a-7579066440d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 25 18:58:06.177184 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Mon Jul 25 18:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 18:58:06.185640 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:58:06.659556 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-b29217ff-81ba-449e-95fc-9fb70b45ee38 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:58:06.680354 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-b29217ff-81ba-449e-95fc-9fb70b45ee38 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.499969 Jul 25 18:58:06.680933 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Jul 25 18:58:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 18:58:06.703807 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG dbcounter [-] [110254] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 18:58:06.707701 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-4fcb7599-bcaa-4554-ab76-44ee09814559 admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:58:06.719242 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-4fcb7599-bcaa-4554-ab76-44ee09814559 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015140 Jul 25 18:58:06.719242 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Mon Jul 25 18:58:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:58:06.731680 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-9eb6a2f6-4363-4785-9329-f39529200220 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:58:06.739798 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-9eb6a2f6-4363-4785-9329-f39529200220 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012392 Jul 25 18:58:06.740364 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Mon Jul 25 18:58:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 18:58:06.752759 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:58:06.761398 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012339 Jul 25 18:58:06.761971 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Mon Jul 25 18:58:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 18:58:06.774707 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-0d65d964-db02-4521-8f58-918c1a511ea7 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 18:58:06.784314 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-0d65d964-db02-4521-8f58-918c1a511ea7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013529 Jul 25 18:58:06.784886 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Mon Jul 25 18:58:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:01:54.830235 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:01:54.831322 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 25 19:01:54.831716 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 19:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:01:54.975681 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_api:SELECT=6 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:01:55.144517 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-afa0392b-7dfb-40c2-bb44-84355850697b admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:01:55.146997 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:01:55.146997 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: warnings.warn(msg) Jul 25 19:01:55.148423 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-afa0392b-7dfb-40c2-bb44-84355850697b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:01:55.148878 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-afa0392b-7dfb-40c2-bb44-84355850697b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:01:55.149968 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-afa0392b-7dfb-40c2-bb44-84355850697b admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:01:55.150457 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-afa0392b-7dfb-40c2-bb44-84355850697b admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:01:55.187587 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-afa0392b-7dfb-40c2-bb44-84355850697b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.213475 Jul 25 19:01:55.188175 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 19:01:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:01:56.098582 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:01:56.099633 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 25 19:01:56.100034 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 19:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:01:56.311465 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-e02bc838-13f5-4951-99c4-b49f0b9dfe21 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:01:56.313923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:01:56.313923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: warnings.warn(msg) Jul 25 19:01:56.315235 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e02bc838-13f5-4951-99c4-b49f0b9dfe21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:01:56.315687 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e02bc838-13f5-4951-99c4-b49f0b9dfe21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:01:56.316493 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e02bc838-13f5-4951-99c4-b49f0b9dfe21 admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:01:56.316927 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e02bc838-13f5-4951-99c4-b49f0b9dfe21 admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:01:56.338881 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-e02bc838-13f5-4951-99c4-b49f0b9dfe21 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091446 Jul 25 19:01:56.343850 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 19:01:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:02:07.655036 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:02:07.656045 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Jul 25 19:02:07.656521 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 19:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:02:07.806773 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_cell0:SELECT=4 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:07.807523 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_cell1:SELECT=4 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:07.808136 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG dbcounter [-] [110253] Writing DB stats nova_api:SELECT=8 {{(pid=110253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:02:07.872821 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-e04cba1f-a269-49eb-82da-51756249c7a2 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:02:07.881402 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:02:07.881402 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: warnings.warn(msg) Jul 25 19:02:07.881402 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e04cba1f-a269-49eb-82da-51756249c7a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:02:07.881402 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e04cba1f-a269-49eb-82da-51756249c7a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:02:07.881402 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e04cba1f-a269-49eb-82da-51756249c7a2 admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:02:07.881960 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-e04cba1f-a269-49eb-82da-51756249c7a2 admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:02:07.913538 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-e04cba1f-a269-49eb-82da-51756249c7a2 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.111931 Jul 25 19:02:07.914197 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 19:02:07 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:02:08.806450 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: DEBUG nova.api.openstack.wsgi [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] Calling method '>' {{(pid=110254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:02:08.807504 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: INFO nova.api.openstack.requestlog [None req-5ae0786e-38be-44e9-8c0a-0decb4a1201f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 25 19:02:08.807930 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: [pid: 110254|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Jul 25 19:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:02:09.006923 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG nova.api.openstack.wsgi [None req-46656004-025a-4c4c-a512-25ad61651105 admin admin] Calling method '>' {{(pid=110253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:02:09.010094 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:02:09.010094 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: warnings.warn(msg) Jul 25 19:02:09.011406 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-46656004-025a-4c4c-a512-25ad61651105 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:02:09.011899 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-46656004-025a-4c4c-a512-25ad61651105 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:02:09.012650 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-46656004-025a-4c4c-a512-25ad61651105 admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:02:09.013075 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: DEBUG oslo_concurrency.lockutils [None req-46656004-025a-4c4c-a512-25ad61651105 admin admin] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:02:09.036135 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: INFO nova.api.openstack.requestlog [None req-46656004-025a-4c4c-a512-25ad61651105 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086672 Jul 25 19:02:09.036795 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: [pid: 110253|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Jul 25 19:02:08 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:03:13.563491 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: Mon Jul 25 19:03:13 2022 - graceful shutdown triggered... Jul 25 19:03:13.563812 dv-cinder-820027-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 19:03:13.564725 dv-cinder-820027-16-iscsi devstack@n-api.service[110254]: Gracefully killing worker 2 (pid: 110254)... Jul 25 19:03:13.565177 dv-cinder-820027-16-iscsi devstack@n-api.service[110253]: Gracefully killing worker 1 (pid: 110253)... Jul 25 19:03:14.564852 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: worker 1 buried after 1 seconds Jul 25 19:03:14.564852 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: worker 2 buried after 1 seconds Jul 25 19:03:14.565619 dv-cinder-820027-16-iscsi devstack@n-api.service[110252]: goodbye to uWSGI. Jul 25 19:03:14.567253 dv-cinder-820027-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 19:03:14.567810 dv-cinder-820027-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 19:03:14.570660 dv-cinder-820027-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 19:03:14.583636 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 19:03:14 2022] *** Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: nodename: dv-cinder-820027-16-iscsi Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: machine: x86_64 Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: clock source: unix Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: pcre jit disabled Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: detected number of CPU cores: 4 Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: current working directory: / Jul 25 19:03:14.586694 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: detected binary path: /usr/bin/uwsgi-core Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: your processes number limit is 47680 Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: your memory page size is 4096 bytes Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: detected max file descriptor number: 2048 Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: lock engine: pthread robust mutexes Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: thunder lock: enabled Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 19:03:14.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 19:03:14.631313 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: Python main interpreter initialized at 0x55ba0db279c0 Jul 25 19:03:14.631313 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: python threads support enabled Jul 25 19:03:14.631313 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: your server socket listen backlog is limited to 100 connections Jul 25 19:03:14.631313 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: your mercy for graceful operations on workers is 90 seconds Jul 25 19:03:14.631813 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 19:03:14.631813 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: *** Operational MODE: preforking *** Jul 25 19:03:14.632090 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: *** uWSGI is running in multiple interpreter mode *** Jul 25 19:03:14.632090 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: spawned uWSGI master process (pid: 125153) Jul 25 19:03:14.632275 dv-cinder-820027-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 19:03:14.636928 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: spawned uWSGI worker 1 (pid: 125166, cores: 1) Jul 25 19:03:14.636928 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: spawned uWSGI worker 2 (pid: 125167, cores: 1) Jul 25 19:03:14.636928 dv-cinder-820027-16-iscsi devstack@n-api.service[125153]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 19:03:15.368523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:03:15.420112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:03:16.694917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:03:16.694917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: from cryptography.utils import int_from_bytes Jul 25 19:03:16.695566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:03:16.695566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: from cryptography.utils import int_from_bytes Jul 25 19:03:16.814818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:03:16.814818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: from cryptography.utils import int_from_bytes Jul 25 19:03:16.815542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:03:16.815542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: from cryptography.utils import int_from_bytes Jul 25 19:03:19.373683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:03:19.373683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:03:19.374960 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:03:19.374960 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:03:19.374960 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:03:19.375476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.375616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.375983 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.376243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.376530 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.376846 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.377178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.377545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.378018 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.378288 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.378637 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.378974 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-16-iscsi {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.379412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.379996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.380313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.380648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.381072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.381384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.381791 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.382238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.383840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.383840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.383840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.384773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.384773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.384773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.385373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.385613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.385870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.386136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.386462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-16-iscsi {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.386895 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.387589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.388008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.388496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.388909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.389230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.389563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.390163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.390649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.390649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.391066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.391486 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.391787 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.392182 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.392568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.392864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.393646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.393880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.394428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.394428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.395015 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.395301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.395545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.396176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.396176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.396905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.396905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.397255 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.397500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.398247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.398247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.404392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.405899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.406463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.406463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.407130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.407130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.407302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.407585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.407929 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.408219 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.408542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.408863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.409774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.410071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.410402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.410720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.411034 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.411351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.411658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.411967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.412291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.412768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.413114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.413449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.413849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.414170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.414508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.414841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.415168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.415485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.415964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.416198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.416612 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.417028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.417028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.420201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.421669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.421669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.421669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.421669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.421669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.421669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.422558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.422558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.423505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.423505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.423505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.424075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.424075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.424573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.424573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.426387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.428567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.428902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.429793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.430156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.430834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.431097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.432807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.433456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.434071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.434646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.435030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.435577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.437127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.437127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.437127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.437930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.438235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.438644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.439153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.439605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.440239 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.440489 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.440757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.441247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.441826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.442184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.442718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.443344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.444330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.444330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.444821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.444821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.445272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.445598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.445814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.446279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.446613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.446792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.447004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.447551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.447784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.447954 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.448267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.448624 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.448952 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.449272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.449593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.449905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.450242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.450823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.451266 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.451607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.451958 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.452277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.452617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.452934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.453262 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.453585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.453985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.454586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.454586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.454897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.455160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.455494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.455821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.456149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.456736 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.457213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.457563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.457946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.458217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.458579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.458865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.459234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.459522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.459844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.460197 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.460626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.460941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.461276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.461596 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.461856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.462435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.471476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.473273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.474567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.476648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.478131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.479566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.480656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.480656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.480656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.480656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.480656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.481369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.481369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.481369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.481840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.482039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.482376 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.482703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.483123 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.483463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.483937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.484100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.484414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.484728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.485052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.485365 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.485679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.486088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.486301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.486646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.487065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.487404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.488595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.488595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.489470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.489470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.489823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.489823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.490160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.490456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.490791 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.491112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.491427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.491741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.492687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.492687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.492687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.493773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.493773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.493773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.494985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.494985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.494985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.495564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.495564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.495998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.495998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.496597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.496597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.496883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.497176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.497507 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.497951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.498152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.498615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.498996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.499757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.499757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.500274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.500623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.500946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.501280 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.501680 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.501937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.502285 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.502664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.503065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.503604 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.503854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.504409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.504581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.505073 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.505270 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.505556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.505799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.506160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.506579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.506797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.507045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.507398 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.507722 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.508251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.508569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.509051 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.509236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.509606 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.510025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.510192 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.510541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.510946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.511203 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.511620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.512808 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.512808 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.512808 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.514597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.514597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.514597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.514597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.514597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.514597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.517240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.518616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.518616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.518616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.518616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.518890 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.519133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.519479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.519969 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.520296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.520645 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.520935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.521250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.521572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.521878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.522179 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.522950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.522950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.523234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.523455 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.523766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.524082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.524406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.524719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.525049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.525394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.525723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.526049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.526385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.526706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.527302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.527302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.527630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.528146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.528296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.528633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.528943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.529264 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.529652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.530056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.530419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.530780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.531093 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.531405 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.531775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.532703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.532703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.532972 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.533355 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.533687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.534605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.535232 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.535706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.536122 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.536489 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.536812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.537139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.537452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.537772 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.538104 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.539254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.539254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.539254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.540201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.540201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.540701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.540960 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.541461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.541741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.541935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.542221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.542581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.542908 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.543309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.543639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.543959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.544326 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.544757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.545120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.545436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.545828 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.546265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.546499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.546817 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.547154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.547512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.547990 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.548303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.548624 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.548936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.549252 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.549573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.550467 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.551915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.551915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.551915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.552405 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.552405 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.552861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.553056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.553326 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.553663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.553963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.554296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.554643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.555045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.555277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.555612 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.555978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.556254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.556688 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.557019 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.557330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.557755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.558075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.558418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.558748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.559080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.559417 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.559722 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.560051 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.560368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.560698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.561106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.561431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.561920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.562266 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.562504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.562841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.563164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.563495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.563940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.564264 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.564666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.565025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.565946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.566754 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.567150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.567515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.567859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.568239 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.568879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.569198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.569550 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.569968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.570311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.570662 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.571238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.571590 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.572039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.572821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.572821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.573481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.573776 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.574117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.574487 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.574937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.575171 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.575494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.575816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.576286 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.576508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.576915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.577273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.577621 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.577947 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.578296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.578671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.579003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.579337 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.579682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.580004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.580319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.580649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.581375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.581712 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.582035 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.582396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.583055 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.583457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.583641 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.583988 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.584397 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.584869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.585930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.585930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.585930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.587163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.587163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.587163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.587651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.587804 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.588169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.589121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.589121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.589121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.589611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.589770 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.590013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.590369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.590702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.591035 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.591369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.591863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.592189 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.592702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.593021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.595726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.598979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.600511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.600511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.600511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.600511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.600511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.601566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.601566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.601566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.602235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.602235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.602699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.602919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.603166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.603665 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.603897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.604141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.604573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.604905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.605310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.605609 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.605945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.606272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.606917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.607250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.608154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.608726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.609199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.609720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.610254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.610833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.611356 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.611892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.613758 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.613936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.614500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.614849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.615292 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.615651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.616026 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.616360 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.616702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.617042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.617727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.618167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.618583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.618918 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.619265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.619877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.620204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.620549 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.620874 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.621209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.621542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.621876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.622278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.622549 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.622877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.623202 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.623521 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.623924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.624175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.624517 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.624833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.625217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.625752 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.626028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.626176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.626437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.626759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.627130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.627400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.627822 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.628094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.628413 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.628739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.629057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.629379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.629759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.630105 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.630502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.630817 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.631153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.631585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.631998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.632248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.632573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.632942 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.633274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.633898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.634239 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.634792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.635151 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.635499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.635913 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.636129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.636448 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.636786 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.637375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.637697 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.638019 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.638392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.638693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.639015 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.639339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.639727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.639983 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.640311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.640712 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.641038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.641363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.641891 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.642444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.642880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.643246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.643631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.644834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.644834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.645276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.645886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.646529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.647078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.647486 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.647783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.648171 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.648661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.649088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.650582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.650582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.650582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.651097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.651394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.651901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.652450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.652717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.653212 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.653581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.653970 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.654608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.655009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.655274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.655597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.656191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.656672 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.657222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.657756 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.658274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.658755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.659760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.660047 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.660448 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.660778 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.661276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.661449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.661820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.662200 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.662589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.662963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.663314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.663675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.664103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.664663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.665299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.666075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.666561 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.667068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.667734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.668257 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.668607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.669208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.669791 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.670345 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.670990 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.671567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.672216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.672833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.673414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.673901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.675641 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.676011 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.676554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.677113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.677698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.678375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.678931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.679576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.680155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.680726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.681369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.681858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.682286 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.682823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.683041 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.683344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.683665 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.684600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.684600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.686461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.686461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.686461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.686461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.687007 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.687007 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.687381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.687541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:03:19.688201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.688360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:03:19.688503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.688666 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:03:19.688821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.688973 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:03:19.688973 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:03:19.689248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.689405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.689744 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.689891 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.690139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.690281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.690596 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.690735 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.691162 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.691330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.691799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.692270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.692602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.692602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:03:19.692941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.693149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.693536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.693985 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.694509 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.695009 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-16-iscsi {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.695471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.696191 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.696528 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.697005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.697396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.697740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.698066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.698643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.698975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.699464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.700193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.700770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.701730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.703160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.703687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.704018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.704414 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.704720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.705149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-16-iscsi {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.705483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.705812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.707547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.707547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.707547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.708192 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.708192 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.708660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.708882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.709088 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.709393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.709808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.710210 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.710590 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.710955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.711215 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.711569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.711827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.712208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.712434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.712693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.713078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.713373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.713761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.714053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.714270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.714541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.714874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.715222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.715610 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.715984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.716409 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.716730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.717825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.717825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.717825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.718499 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.718499 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.718935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.719146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.719352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.719715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.719970 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.720290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.720640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.721089 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.721525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.734649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.736603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.738662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.740332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.742598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.744746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.744746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.744746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.744746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.744746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.746008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.746008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.746008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.746008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.747142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.747142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.747142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.748370 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.748558 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.749096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.749303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.749751 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.750181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.750460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:03:19.750927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.751996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.751996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.751996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.752509 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.752684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.753065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.753393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.753946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.754201 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.754453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.754840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.755206 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.755560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.755988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.756440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.756749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.757141 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.757660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.758049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.758272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.758678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.759021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.759371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.759775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.760195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.760556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.760918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.761307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.762307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.762307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.763170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.763170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.763527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.763807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.764371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.764766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.765121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.765480 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.765865 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.766294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.766673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.767002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.767489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.767652 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.767971 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.768960 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.769492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.770076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.770690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.771248 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.771786 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.772444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.772997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.773833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.774595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.775834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.775834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.776216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.778196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.778196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.778196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.778196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.778196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.788567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.789636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.790226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.791367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.791367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.791367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.791367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.791837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.791989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.792948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.792948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.793435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.793601 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.793903 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.794243 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.794600 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.794935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.795349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.795706 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.796087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.796508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.796946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.797330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.797580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.798044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.798413 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.798839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.799175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.799595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.799936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.800300 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.800671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.800980 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.801345 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.801676 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.804196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.804196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.804196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.804196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.804196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.804196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.805220 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.805220 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.805527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.806057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.806676 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.807162 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.807454 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO dbcounter [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Registered counter for database nova_api Jul 25 19:03:19.807671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.807893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.808256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.808606 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.808922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.809612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.809612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.811521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.811521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.811521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.811521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.812524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.812524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.812901 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.813211 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.813575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.813825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.814169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.814527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.814852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.816756 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.816756 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.816756 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.816756 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.816756 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.817655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.817655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.817655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.818225 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.818507 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.819392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.819392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.819983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.819983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.820473 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.820720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.820966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.821315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.821641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.821966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.822286 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.822632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.823911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.823911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.823911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.823911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.824627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.824627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.825047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.825244 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.825562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.826802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.826802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.826802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.827327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.831964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.836039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.836039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.836039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.836039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.837178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_db.sqlalchemy.engines [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:19.837410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.837410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.837410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.837410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.837410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.837410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.839460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.839460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.839460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.839460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.840882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.840882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.840882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.841919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.841919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.842245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.843095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.843380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.843922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.844481 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.845063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.846060 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.846399 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.847271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.847905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.856999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.856999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writer thread running {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.857956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.859951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.861766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.861766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.861766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.861766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.861766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.861766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.863172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.863172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.863172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.863808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.864743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.865049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.865497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.865947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.866602 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.867039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.867560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.868206 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.868644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.869176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.869718 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.870389 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.870881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.871442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.871988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.872904 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.873138 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.873656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.874278 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.875003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.875337 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.875880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.876441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.877015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.877523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.878167 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.878698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.879887 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.880439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.880972 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.881611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.882050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.882703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.883156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.883642 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.884108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.884564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.885019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.885580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.885988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.886559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.887789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.889301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.889883 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.890488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.891106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.891693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.892283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.892888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.893399 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.894915 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.895378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.895860 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.896339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.896914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.897360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.897814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.898285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.900521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.901106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.901617 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.902082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.902615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.903087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.903622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.904074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.904567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.905029 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.905478 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.905951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.906447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.906914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.908475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.908475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.908475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.908475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.908838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.909179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.910031 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.910391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.910829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.911233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.911697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.912097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.912428 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.912760 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.913116 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.913450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.913851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.914189 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.914536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.914862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.915320 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.915519 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.915837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.916174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.916626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.917119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.917316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.917728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.918152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.918612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.919024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.919368 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.919709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.920090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.920718 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.921089 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.921343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.921645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.921997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.922431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.922820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.923166 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.923534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.923869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.924208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.924659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.925234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.925673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.926011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.926405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.926767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.927091 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.927441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.928106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.928106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.928483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.928784 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.929109 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.929430 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.929756 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.930074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.930435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.930899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.931266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.931402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.931728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.932170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.932442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.932710 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.933151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.933419 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.933697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.934010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.934416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.934704 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.935021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.935357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.935707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.936123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.936451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.936871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.937127 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.937457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.937788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.938134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.938480 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.938800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.939121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.939435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.939757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.940069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.940724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.940724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.941948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.941948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.941948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.942511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.942511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.942820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.943263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.943725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.context [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04f7c03e-eb8a-4b91-bf46-eb25d497e920(cell1) {{(pid=125166) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:03:19.943917 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.944085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.944548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.945134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.946135 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.946548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.946894 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.948360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.948360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.948622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.949048 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.949197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.950293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.950293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.950293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.957131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:03:19.957131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:03:19.957437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.957437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.957731 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:03:19.957848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.957848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.957848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.957848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.958123 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:03:19.958259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.958259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.958812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.960136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO dbcounter [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Registered counter for database nova_cell0 Jul 25 19:03:19.962376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.962376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.962376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.962880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.963003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.963722 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.964188 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.964720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.965482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.965854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.967292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.967429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO dbcounter [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Registered counter for database nova_cell1 Jul 25 19:03:19.967546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.967546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.968071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.968622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.969171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.970119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.970485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.971005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.971611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.972752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.973316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.973845 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.974452 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.975221 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.975545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.976088 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.976560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.977156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.977331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.977697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.978060 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.978440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.978780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.979205 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.979640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.980232 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_db.sqlalchemy.engines [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:19.980394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.980630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.980989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.981336 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.981679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.982017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.982471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.982875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.983291 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.983611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.983835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_db.sqlalchemy.engines [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:19.983993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.984438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.984714 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.985307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.985964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.986440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.987070 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.990808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.991184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writer thread running {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:19.992051 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.992674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.993274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.994015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.994664 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.995234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.995803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.996379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.996921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.997486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.998053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.998598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.999088 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.999512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:19.999859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.000275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.000602 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.000935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.001286 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.001663 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.002099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.002453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.002808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.003158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.003488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.003814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.004141 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.004517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.005096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.005511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.005846 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.006173 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.006531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.006856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.007183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.007563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.008084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.008487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.008916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.009364 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.009940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.010443 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.010830 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.011293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.011851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.012643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.013623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.014232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.014825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.015393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.015967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.016517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.017030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.017585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.018084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.019184 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.019661 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.020019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.020419 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.020945 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.021471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.021996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.022561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.023107 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.023678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.024260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.024838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.025417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.026009 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.026731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.027262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.027852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.028435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.029097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.029614 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.030192 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.030811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.031392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.031951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.032909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.032909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.032909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.035400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.035400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.035400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.035400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.036232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.036232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.036232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.036657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.036823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.037147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.037489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.037849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.038207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.038795 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.039123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.039447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.039769 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.040093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.040428 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.040880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.041223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.041541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.041842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.042166 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.042831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.043152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.043470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.043847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.044111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.044427 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.044746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.045070 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.045378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.045693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.046013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.046362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.047100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.047423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.047734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.048081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.048593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.048815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.049161 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.049557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.049926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.050262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.050744 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.051798 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.051798 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.051798 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.052355 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.052521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.052789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.053236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.053609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.053942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.054311 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.055114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.055389 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.055694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.056018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.056364 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.056699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.057112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.057390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.057719 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.058057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.060036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.060346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.060736 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.061285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.061826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.062884 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.063471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.064054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.064757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.065155 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.066441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.066806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.067147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.067592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.067855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.068337 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.068905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.069540 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.070070 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.070451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.070829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.071276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:03:20.071695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:03:20.152631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO dbcounter [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Registered counter for database nova_api Jul 25 19:03:20.180855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_db.sqlalchemy.engines [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:20.190176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writer thread running {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:20.191448 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writer thread running {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:20.203301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO dbcounter [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Registered counter for database nova_cell0 Jul 25 19:03:20.212278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_db.sqlalchemy.engines [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:20.220985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writer thread running {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:20.270506 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.context [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04f7c03e-eb8a-4b91-bf46-eb25d497e920(cell1) {{(pid=125167) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:03:20.275139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:03:20.277201 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:03:20.278399 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:03:20.281282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:03:20.283799 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO dbcounter [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Registered counter for database nova_cell0 Jul 25 19:03:20.289165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO dbcounter [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Registered counter for database nova_cell1 Jul 25 19:03:20.300092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_db.sqlalchemy.engines [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:20.301513 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_db.sqlalchemy.engines [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:20.309834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writer thread running {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:20.310275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writer thread running {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:20.483488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO dbcounter [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Registered counter for database nova_cell0 Jul 25 19:03:20.492920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_db.sqlalchemy.engines [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:03:20.500309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writer thread running {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:03:20.597782 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: WARNING keystonemiddleware.auth_token [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:03:20.604079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: WARNING keystonemiddleware.auth_token [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:03:20.916634 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: WARNING keystonemiddleware.auth_token [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:03:20.927559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: WARNING keystonemiddleware.auth_token [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:03:20.996815 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: WARNING keystonemiddleware.auth_token [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:03:21.004071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: WARNING keystonemiddleware.auth_token [None req-c07f4720-bf60-4f18-8e67-109de9eb7c09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:03:21.010032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ba0db279c0 pid: 125166 (default app) Jul 25 19:03:21.318445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: WARNING keystonemiddleware.auth_token [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:03:21.324637 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: WARNING keystonemiddleware.auth_token [None req-de59ad36-57e4-42c7-ad7c-2ea9efe197ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:03:21.330087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ba0db279c0 pid: 125167 (default app) Jul 25 19:04:08.940626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:08.941503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:08.942276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:08.943062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:10.589493 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aace3074-931b-4091-927a-282a4b3e597d tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Action: 'create', calling method: .version_select at 0x7fd8e7c564c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-902223892", "metadata": {"Type": "work"}}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aace3074-931b-4091-927a-282a4b3e597d tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Request method failure captured: Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 121 Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uko6N2UD5B9SR5fYx7hmhLLlw4pjb7AFUWrLL-Xqh-8XesvgFQptW8C9Wvczc8vlH4ZJFraky9kt4dtLb0ZTr4vj8YJv3zeThldL5PGAm_pdKE9rIz5PRbzpaToMw1HH4Fp2lO01oyJWmmZqJhiVH2vZDQe4DaxNEgg2JEr7z0ViZY Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:04:10.597338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0645a63ae797444585edd4eb2924f1e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: a324e94f4e1b4199b684514b8818dda4 Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-902223892", "metadata": {"Type": "work"}}} Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: Jul 25 19:04:10.598801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-902223892', 'metadata': {'Type': 'work'}}}} Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise error Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:04:10.599701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 19:04:10.601049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 19:04:10.602230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 19:04:10.602230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:10.604091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aace3074-931b-4091-927a-282a4b3e597d tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:04:10.605473 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-aace3074-931b-4091-927a-282a4b3e597d tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.674860 Jul 25 19:04:10.606413 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Jul 25 19:04:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1677 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:04:10.622163 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:10.623113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:10.624077 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:10.631485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:11.030744 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b4c48f2-1e27-41ad-8cbc-b9f531b07600 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Action: 'create', calling method: .version_select at 0x7fd8e7c9a0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-618000804", "metadata": {"Type": "work"}}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b4c48f2-1e27-41ad-8cbc-b9f531b07600 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Request method failure captured: Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 119 Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uko6N2UD5B9SR5fYx7hmhLLlw4pjb7AFUWrLL-Xqh-8XesvgFQptW8C9Wvczc8vlH4ZJFraky9kt4dtLb0ZTr4vj8YJv3zeThldL5PGAm_pdKE9rIz5PRbzpaToMw1HH4Fp2lO01oyJWmmZqJhiVH2vZDQe4DaxNEgg2JEr7z0ViZY Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:04:11.038175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0645a63ae797444585edd4eb2924f1e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: a324e94f4e1b4199b684514b8818dda4 Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-618000804", "metadata": {"Type": "work"}}} Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: Jul 25 19:04:11.039959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-618000804', 'metadata': {'Type': 'work'}}}} Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise error Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi '0' Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:04:11.040820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 19:04:11.043450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 19:04:11.048037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 19:04:11.048037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.048037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b4c48f2-1e27-41ad-8cbc-b9f531b07600 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:04:11.048037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4b4c48f2-1e27-41ad-8cbc-b9f531b07600 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.423558 Jul 25 19:04:11.048037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Jul 25 19:04:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 431 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:04:11.052930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ebf90bcf-c5f5-4a90-8c5c-1426422f2903 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Action: 'create', calling method: .version_select at 0x7fd8e7c56550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1053724455", "metadata": {"Type": "work"}}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ebf90bcf-c5f5-4a90-8c5c-1426422f2903 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Request method failure captured: Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 119 Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uko6N2UD5B9SR5fYx7hmhLLlw4pjb7AFUWrLL-Xqh-8XesvgFQptW8C9Wvczc8vlH4ZJFraky9kt4dtLb0ZTr4vj8YJv3zeThldL5PGAm_pdKE9rIz5PRbzpaToMw1HH4Fp2lO01oyJWmmZqJhiVH2vZDQe4DaxNEgg2JEr7z0ViZY Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:04:11.057526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0645a63ae797444585edd4eb2924f1e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: a324e94f4e1b4199b684514b8818dda4 Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1053724455", "metadata": {"Type": "work"}}} Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: Jul 25 19:04:11.062902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1053724455', 'metadata': {'Type': 'work'}}}} Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise error Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi '' Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:04:11.066925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 19:04:11.072814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 19:04:11.076081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 19:04:11.076081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:11.076081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ebf90bcf-c5f5-4a90-8c5c-1426422f2903 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:04:11.076081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ebf90bcf-c5f5-4a90-8c5c-1426422f2903 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010858 Jul 25 19:04:11.076081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Jul 25 19:04:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 19:04:11.083065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0f4f541d-d63a-4da6-b364-cdd5eda636f7 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Calling method '.version_select at 0x7fd8e7c9a940>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:12.344199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-0f4f541d-d63a-4da6-b364-cdd5eda636f7 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] HTTP exception thrown: Volume tempest-invalid-1216214041 could not be found. Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0f4f541d-d63a-4da6-b364-cdd5eda636f7 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Request method failure captured: Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1216214041 HTTP/1.1 Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uko6N2UD5B9SR5fYx7hmhLLlw4pjb7AFUWrLL-Xqh-8XesvgFQptW8C9Wvczc8vlH4ZJFraky9kt4dtLb0ZTr4vj8YJv3zeThldL5PGAm_pdKE9rIz5PRbzpaToMw1HH4Fp2lO01oyJWmmZqJhiVH2vZDQe4DaxNEgg2JEr7z0ViZY Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:04:12.351303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0645a63ae797444585edd4eb2924f1e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: a324e94f4e1b4199b684514b8818dda4 Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Volume tempest-invalid-1216214041 could not be found. Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'tempest-invalid-1216214041'} Jul 25 19:04:12.353044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1216214041 could not be found. (HTTP 404) (Request-ID: req-fafe36ff-5f7a-4782-94b3-846daac24594) Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.353921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:04:12.355330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1216214041 could not be found. Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:04:12.356534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1216214041 could not be found. Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1216214041 could not be found. Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0f4f541d-d63a-4da6-b364-cdd5eda636f7 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Returning 404 to user: Volume tempest-invalid-1216214041 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:04:12.357554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0f4f541d-d63a-4da6-b364-cdd5eda636f7 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1216214041" status: 404 len: 99 microversion: 2.1 time: 1.287236 Jul 25 19:04:12.358697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Jul 25 19:04:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1216214041 => generated 99 bytes in 1293 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 19:04:12.368331 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ef316032-c4ec-4ce4-aae8-02139a602ea0 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004305 Jul 25 19:04:12.369018 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1140 bytes} [Mon Jul 25 19:04:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 25 19:04:12.379987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8f06b43a-0f58-4acf-8e06-c99698fc6cf1 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004846 Jul 25 19:04:12.381872 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1137 bytes} [Mon Jul 25 19:04:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 19:04:12.397052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7928b113-153a-4df6-a00f-3ed2a48d85c9 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Calling method '.version_select at 0x7fd8e7b12310>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:12.747197 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-7928b113-153a-4df6-a00f-3ed2a48d85c9 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] HTTP exception thrown: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7928b113-153a-4df6-a00f-3ed2a48d85c9 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Request method failure captured: Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/os-volumes/bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 HTTP/1.1 Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uko6N2UD5B9SR5fYx7hmhLLlw4pjb7AFUWrLL-Xqh-8XesvgFQptW8C9Wvczc8vlH4ZJFraky9kt4dtLb0ZTr4vj8YJv3zeThldL5PGAm_pdKE9rIz5PRbzpaToMw1HH4Fp2lO01oyJWmmZqJhiVH2vZDQe4DaxNEgg2JEr7z0ViZY Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:04:12.755656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0645a63ae797444585edd4eb2924f1e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: a324e94f4e1b4199b684514b8818dda4 Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1'} Jul 25 19:04:12.758265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. (HTTP 404) (Request-ID: req-711f34de-4167-47ac-a854-68068365c10b) Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.759681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:04:12.761605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 19:04:12.763726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7928b113-153a-4df6-a00f-3ed2a48d85c9 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Returning 404 to user: Volume bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7928b113-153a-4df6-a00f-3ed2a48d85c9 tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1" status: 404 len: 109 microversion: 2.1 time: 0.373803 Jul 25 19:04:12.770415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:04:12 2022] DELETE /compute/v2.1/os-volumes/bb7a7615-6a4e-4f46-bddf-5382aa4f7cc1 => generated 109 bytes in 377 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:04:12.775026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7f932327-d014-49d2-8acf-c1c1dbf3140f tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Calling method '.version_select at 0x7fd8e7a89e50>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-7f932327-d014-49d2-8acf-c1c1dbf3140f tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] HTTP exception thrown: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7f932327-d014-49d2-8acf-c1c1dbf3140f tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Request method failure captured: Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/os-volumes/b7f1637c-3a10-4839-8d15-5550ddfc6af7 HTTP/1.1 Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uko6N2UD5B9SR5fYx7hmhLLlw4pjb7AFUWrLL-Xqh-8XesvgFQptW8C9Wvczc8vlH4ZJFraky9kt4dtLb0ZTr4vj8YJv3zeThldL5PGAm_pdKE9rIz5PRbzpaToMw1HH4Fp2lO01oyJWmmZqJhiVH2vZDQe4DaxNEgg2JEr7z0ViZY Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:04:12.865631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0645a63ae797444585edd4eb2924f1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0645a63ae797444585edd4eb2924f1e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 0645a63ae797444585edd4eb2924f1e6 Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesNegativeTest-465258919 Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: a324e94f4e1b4199b684514b8818dda4 Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesNegativeTest-465258919-project Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'b7f1637c-3a10-4839-8d15-5550ddfc6af7'} Jul 25 19:04:12.867006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. (HTTP 404) (Request-ID: req-5f1fc034-8766-4e01-926c-a3891e0b6dc3) Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.868381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:04:12.869762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 19:04:12.871092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. Jul 25 19:04:12.872251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:04:12.879439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7f932327-d014-49d2-8acf-c1c1dbf3140f tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] Returning 404 to user: Volume b7f1637c-3a10-4839-8d15-5550ddfc6af7 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:04:12.882495 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7f932327-d014-49d2-8acf-c1c1dbf3140f tempest-VolumesNegativeTest-465258919 tempest-VolumesNegativeTest-465258919-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b7f1637c-3a10-4839-8d15-5550ddfc6af7" status: 404 len: 109 microversion: 2.1 time: 0.110299 Jul 25 19:04:12.911781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:04:12 2022] GET /compute/v2.1/os-volumes/b7f1637c-3a10-4839-8d15-5550ddfc6af7 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:04:14.558155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7e61654f-944c-4a5d-85db-f0e371f8a867 tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a91f70>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:14.688083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7e61654f-944c-4a5d-85db-f0e371f8a867 tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/44e4b8ec-98f5-412f-aeee-d4c370762261" status: 200 len: 351 microversion: 2.1 time: 0.135228 Jul 25 19:04:14.688816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:04:14 2022] GET /compute/v2.1/os-volumes/44e4b8ec-98f5-412f-aeee-d4c370762261 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:04:19.892363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5fbf6f7c-c9cb-40a8-be96-95a276f6491c tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a37af0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:20.008442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5fbf6f7c-c9cb-40a8-be96-95a276f6491c tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/81425d28-3578-4515-bebd-44f976d5a575" status: 200 len: 350 microversion: 2.1 time: 0.146004 Jul 25 19:04:20.009465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:04:19 2022] GET /compute/v2.1/os-volumes/81425d28-3578-4515-bebd-44f976d5a575 => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:24.044526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1d0b683f-0e7b-4699-95eb-e102c1021bff tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a40670>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:24.215150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1d0b683f-0e7b-4699-95eb-e102c1021bff tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/bb08bb53-e99d-4735-92a9-1fd723e43119" status: 200 len: 350 microversion: 2.1 time: 0.179114 Jul 25 19:04:24.229400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:04:24 2022] GET /compute/v2.1/os-volumes/bb08bb53-e99d-4735-92a9-1fd723e43119 => generated 350 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:24.239305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ccd22e06-85f0-429b-9c9b-6fa6247791ab tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a89af0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:24.446720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ccd22e06-85f0-429b-9c9b-6fa6247791ab tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.214337 Jul 25 19:04:24.447380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1134 bytes} [Mon Jul 25 19:04:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:24.465609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5f0ae53a-44d7-4794-8dec-4c2cf4be654a tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a37940>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:24.613544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b0f94f20-1162-4ae0-ab20-1b5f193e8927 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: .version_select at 0x7fd8e7a91dc0>, body: {"keypair": {"name": "tempest-keypair-710729291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt2FE18t5xKI7kt9HlB9rvV8ZgcmfrTxuwGr45hgM5ed3zuOf69pYmVtin0Yreqi+F48HnoIpjy4kHBxZk63YbKkcIu3ZoTSLUpetJ1LjTyjAvB6Ou+91DNDvvyH0Nqhg=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:24.717092 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-b0f94f20-1162-4ae0-ab20-1b5f193e8927 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:24.741538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-b0f94f20-1162-4ae0-ab20-1b5f193e8927 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for user 592de777b94148b791e18bf898386f34 and project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:24.779825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5f0ae53a-44d7-4794-8dec-4c2cf4be654a tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.318085 Jul 25 19:04:24.781163 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1149 bytes} [Mon Jul 25 19:04:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:24.803588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e62274f8-ff14-410d-ba68-9d9f7559897d tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a41e50>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:25.016093 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b0f94f20-1162-4ae0-ab20-1b5f193e8927 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.685678 Jul 25 19:04:25.016093 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 7/14] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:04:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:04:25.051918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e62274f8-ff14-410d-ba68-9d9f7559897d tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.255756 Jul 25 19:04:25.052918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1134 bytes} [Mon Jul 25 19:04:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:25.068061 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f2d2f8e1-8238-49e0-b899-d60b481c0105 tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a15700>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:25.367400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f2d2f8e1-8238-49e0-b899-d60b481c0105 tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.305009 Jul 25 19:04:25.380013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1167 bytes} [Mon Jul 25 19:04:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:25.385360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b43bb202-25b6-4162-9fe0-fcb8a173989b tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e82f7e50>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:25.629390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b43bb202-25b6-4162-9fe0-fcb8a173989b tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.248703 Jul 25 19:04:25.630443 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 9/17] 10.222.0.17 () {58 vars in 1170 bytes} [Mon Jul 25 19:04:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:25.648134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8a6539a4-fd5b-4485-a01f-a3578950bbbb tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a15b80>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:25.830294 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8a6539a4-fd5b-4485-a01f-a3578950bbbb tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187816 Jul 25 19:04:25.844379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 9/18] 10.222.0.17 () {58 vars in 1155 bytes} [Mon Jul 25 19:04:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:25.848105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-81c5ba06-0857-4e83-8012-74134e3778f8 tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e7a37ca0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:26.100272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-81c5ba06-0857-4e83-8012-74134e3778f8 tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.255986 Jul 25 19:04:26.101802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1188 bytes} [Mon Jul 25 19:04:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:26.130845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2b9e4db9-4a51-4e44-9fde-8700b99ab59a tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] Calling method '.version_select at 0x7fd8e79ccf70>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:26.434503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2b9e4db9-4a51-4e44-9fde-8700b99ab59a tempest-VolumesTestJSON-780398071 tempest-VolumesTestJSON-780398071-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.320784 Jul 25 19:04:26.453090 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1155 bytes} [Mon Jul 25 19:04:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:27.887085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-860175816", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:28.216216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] validate_networks() for [('9229fc30-046e-4028-a03d-cbb3123aa86d', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:04:30.243095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-caa904a1-3ee8-4aba-ab96-97fa19f1025d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'create', calling method: .version_select at 0x7fd8e79cc310>, body: {"keypair": {"name": "tempest-keypair-1618047512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS9kipCpBOPrEHIZ+f00y8kiUbHzB/Xqq3njGcmTUg6WiLisjcK9oB0t3dLTLd601HoSrQk9emvpK1d3DyqkubE3JCz8SnI3XWINbmqG7lwxNhTOBZjF4/GfnZhzg451A=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:30.298272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-caa904a1-3ee8-4aba-ab96-97fa19f1025d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:30.310631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-caa904a1-3ee8-4aba-ab96-97fa19f1025d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for user c99e02a845184f0aa206ba9f209ae4ef and project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:30.443098 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-caa904a1-3ee8-4aba-ab96-97fa19f1025d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.323283 Jul 25 19:04:30.446998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 11/21] 10.222.0.17 () {62 vars in 1200 bytes} [Mon Jul 25 19:04:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 328 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 19:04:31.693333 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:04:31.694004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:04:31.694167 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:04:31.694898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:04:31.695447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:04:31.746428 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:31.746887 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:31.747697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:31.748218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:31.853965 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1159216686", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "networks": [{"uuid": "bf0ea9a3-4a87-4dd5-943d-fdc967447281"}]}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:31.886691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:31.902230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for user 7e3f168283ba4f159948830f396ae7cf and project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:31.949997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:04:31.960550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:04:32.198761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] validate_networks() for [('bf0ea9a3-4a87-4dd5-943d-fdc967447281', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:04:32.224213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-29cfce64-2247-4ead-9c77-a3691fae0dff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.641197 Jul 25 19:04:32.233559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 11/22] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:04:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 4645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:04:32.254825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3c265700-d1f1-467e-bfe6-306997ae6336 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:32.255675 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3c265700-d1f1-467e-bfe6-306997ae6336 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:32.413508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3c265700-d1f1-467e-bfe6-306997ae6336 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:32.468355 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3c265700-d1f1-467e-bfe6-306997ae6336 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1221 microversion: 2.1 time: 0.216582 Jul 25 19:04:32.469598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:32 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:32.662259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1156319825", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:32.952965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] validate_networks() for [('9229fc30-046e-4028-a03d-cbb3123aa86d', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:04:35.468708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:04:35.471796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:04:35.472674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:04:35.473344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:04:35.473926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:04:35.505412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:35.509862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:35.513176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:35.516654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:35.615417 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Getting quotas for project 463f573db9d84c03900d443e4f6585cd. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:35.631326 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Getting quotas for user c0464996da4f44008ca8b91c837ac22d and project 463f573db9d84c03900d443e4f6585cd. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:35.678601 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:04:35.691594 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:04:36.067693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f4ec952d-49e2-4bb8-beaf-f60920fd9a37 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.419373 Jul 25 19:04:36.068840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 12/24] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:04:36.094046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-47e8f5e7-7a0e-42e2-83d9-d0f8b9c402ce tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:36.098074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-47e8f5e7-7a0e-42e2-83d9-d0f8b9c402ce tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:36.522885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-47e8f5e7-7a0e-42e2-83d9-d0f8b9c402ce tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:36.558446 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-47e8f5e7-7a0e-42e2-83d9-d0f8b9c402ce tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1215 microversion: 2.1 time: 0.470470 Jul 25 19:04:36.583762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:36 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1215 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:36.758365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:04:36.765230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:04:36.765230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:04:36.765230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:04:36.765230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:04:36.788628 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:36.793911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:36.793911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:36.793911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:36.842232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:36.849392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for user 7e3f168283ba4f159948830f396ae7cf and project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:36.871160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:04:36.898958 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:04:37.122023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d58e9700-c621-4e95-8724-87e153180b48 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.464080 Jul 25 19:04:37.127164 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 13/26] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:04:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 4469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 19:04:37.140237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6bcea4fd-b827-4140-ad0c-44b3a7cf9ae0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:37.143041 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6bcea4fd-b827-4140-ad0c-44b3a7cf9ae0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:37.449407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6bcea4fd-b827-4140-ad0c-44b3a7cf9ae0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:37.463728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6bcea4fd-b827-4140-ad0c-44b3a7cf9ae0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1222 microversion: 2.1 time: 0.329958 Jul 25 19:04:37.468735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:37 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:37.607700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3170ecbd-b61a-4a0f-977b-d58191d266b4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:37.609613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3170ecbd-b61a-4a0f-977b-d58191d266b4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:37.789630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3170ecbd-b61a-4a0f-977b-d58191d266b4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:37.800919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3170ecbd-b61a-4a0f-977b-d58191d266b4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1215 microversion: 2.1 time: 0.195435 Jul 25 19:04:37.801847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 14/28] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:37 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:37.913146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1200826422", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cdac28d-1b45-4945-96b5-e0fd0c76cca8"}], "security_groups": [{"name": "tempest-securitygroup--1595580711"}], "key_name": "tempest-keypair-1618047512", "user_data": "}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:38.330058 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] validate_networks() for [('0cdac28d-1b45-4945-96b5-e0fd0c76cca8', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:04:38.467346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-92851995", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6572528-5d40-45d4-b911-d98d584260e1"}], "security_groups": [{"name": "tempest-securitygroup--1459127027"}], "key_name": "tempest-keypair-710729291", "user_data": "}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:39.223479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] validate_networks() for [('d6572528-5d40-45d4-b911-d98d584260e1', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:04:39.810254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:04:39.816450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:04:39.816450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:04:39.816450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:04:39.816450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:04:39.864043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:39.864043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:39.868061 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:39.871153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:39.963265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:39.972904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for user c99e02a845184f0aa206ba9f209ae4ef and project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:39.999828 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:04:40.007408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:04:40.324607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-498a9184-8019-4d9d-b34e-f46371d9d025 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.424988 Jul 25 19:04:40.325860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 15/29] 10.222.0.17 () {62 vars in 1188 bytes} [Mon Jul 25 19:04:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 19:04:40.362941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:40.362941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:40.403108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:40.403888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:40.407314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:40.408633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:40.837668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:04:40.839144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:04:40.842789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:04:40.843582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:04:40.844636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:04:40.857517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:40.858399 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:40.859669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:40.860449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:40.893946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:40.905061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:04:40.917669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for user 592de777b94148b791e18bf898386f34 and project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:04:40.918806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c860ed53-f5c5-446a-8216-e0a10b61a9f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1274 microversion: 2.1 time: 0.590536 Jul 25 19:04:40.919811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 16/30] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:40 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1274 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:40.950292 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:40.951386 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:40.986205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:40.987380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:40.988143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:40.990805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:04:40.993892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:41.003421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:04:41.315116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:41.350314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-06c45f6c-f59d-4464-97a7-0caa0ffe170e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1211 microversion: 2.1 time: 0.427062 Jul 25 19:04:41.351642 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 17/31] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:40 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1211 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:41.399420 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ec55c10b-20a0-4407-9638-5fcfa042b819 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:41.413518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ec55c10b-20a0-4407-9638-5fcfa042b819 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:41.454978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-204bc27b-bd82-4718-80bd-108530eea9a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.986979 Jul 25 19:04:41.456082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 15/32] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:04:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 19:04:41.495947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c623993a-c515-4cff-84fb-c79e2ee34ea7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:41.497284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c623993a-c515-4cff-84fb-c79e2ee34ea7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:41.715122 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c623993a-c515-4cff-84fb-c79e2ee34ea7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:41.745650 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c623993a-c515-4cff-84fb-c79e2ee34ea7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1235 microversion: 2.1 time: 0.279946 Jul 25 19:04:41.755934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 16/33] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:41 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1235 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:41.759935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ec55c10b-20a0-4407-9638-5fcfa042b819 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:41.776894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ec55c10b-20a0-4407-9638-5fcfa042b819 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:41.780369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ec55c10b-20a0-4407-9638-5fcfa042b819 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:41.785134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ec55c10b-20a0-4407-9638-5fcfa042b819 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1282 microversion: 2.20 time: 0.429678 Jul 25 19:04:41.785134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 18/34] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:41 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1282 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:41.957910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:41.968734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:42.007818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:42.013669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:42.017627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:42.022232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:42.378605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:42.379270 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:42.410972 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:42.417054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:42.419268 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:42.424721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:43.373692 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:43.421676 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-afd61db9-2045-4718-8563-297e5f798eb0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1282 microversion: 2.1 time: 1.468155 Jul 25 19:04:43.435983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 17/35] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:41 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1282 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:43.445889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-23fc2051-a081-4070-a12c-62535a3d4c98 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:43.446879 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-23fc2051-a081-4070-a12c-62535a3d4c98 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:43.657670 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:43.683950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-63d59008-690b-4779-8a62-1af9c26dbb92 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1275 microversion: 2.1 time: 1.314085 Jul 25 19:04:43.700326 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 19/36] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:42 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1275 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:43.773646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:43.773940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:43.834113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:43.834113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:43.885428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:43.916141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:44.390222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:44.432241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:44.442176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:44.449845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fcf5f906-cf53-4607-b57d-3229d0a60ed1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1278 microversion: 2.20 time: 0.728437 Jul 25 19:04:44.452258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 20/37] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:43 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1278 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:44.472194 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:44.473117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:44.497485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:44.500718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:44.504720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:44.507378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:44.521737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-23fc2051-a081-4070-a12c-62535a3d4c98 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:44.566036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-23fc2051-a081-4070-a12c-62535a3d4c98 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1235 microversion: 2.1 time: 1.139230 Jul 25 19:04:44.572393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 18/38] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:43 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1235 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:44.740941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:44.746014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:44.785160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:44.788520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:44.793044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:44.793867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:44.871097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:44.899452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-529800b5-d56a-4bf2-a3b1-d728ad652d58 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1280 microversion: 2.1 time: 0.445402 Jul 25 19:04:44.936166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 21/39] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:44 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1280 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:45.159853 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:45.188209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0562b97e-79cc-4191-9afc-30fde3140e7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1273 microversion: 2.1 time: 0.454290 Jul 25 19:04:45.197952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 19/40] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:44 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1273 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:45.502824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:45.506427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:45.527199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:45.527886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:45.528892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:45.529394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:45.614982 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:45.622733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:45.656996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:45.658424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:45.662943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:45.668736 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:45.674177 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:45.704888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:45.718608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:45.718608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a0e5b16b-c675-4bac-b420-bdb9f79f1319 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1334 microversion: 2.20 time: 0.211003 Jul 25 19:04:45.745367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 22/41] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:45 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1334 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:45.942153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:45.944065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:45.959483 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:45.961278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:45.972801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:45.973084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:45.974917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:45.982990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dd9de8fc-831f-4f2d-985e-1b970d04ec8a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1231 microversion: 2.1 time: 0.382453 Jul 25 19:04:46.002946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 20/42] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:45 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1231 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:46.244048 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:46.247031 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:46.283195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:46.283732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:46.284447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:46.284949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:46.547725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:46.560784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-56eabb5e-fd75-4cf4-a57a-7aa537b33f68 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1280 microversion: 2.1 time: 0.623674 Jul 25 19:04:46.561526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:45 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1280 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:46.663788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:46.713685 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a62e0575-59c4-4410-b4f4-b4feeba1f28a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1273 microversion: 2.1 time: 0.481168 Jul 25 19:04:46.716047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 21/44] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:46 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1273 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:46.812299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:46.812299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:46.812299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:46.812299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:46.813085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:46.813085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:47.025370 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:47.052012 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:47.064434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:47.137275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:47.147034 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:47.151289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:47.155597 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:47.163054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:47.163760 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:47.177925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6300cf8b-69d3-419a-acf3-5360ab657142 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1352 microversion: 2.20 time: 0.421645 Jul 25 19:04:47.183950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 24/45] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:46 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1352 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:47.536593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:47.572515 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0e75db0a-9125-4946-a239-dfd25ea3fbda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1287 microversion: 2.1 time: 0.558120 Jul 25 19:04:47.572515 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 22/46] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:47 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1287 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:47.594883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:47.596221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:47.610802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:47.613289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:47.614806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:47.615560 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:47.745075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:47.746108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:47.767867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:47.768821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:47.769956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:47.770984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:49.094874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:49.149434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-188336e5-a14a-4cae-b307-80cc3031a3ac tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 1.410176 Jul 25 19:04:49.149434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 23/47] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:47 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:49.184474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:49.185835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:49.204843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:49.205091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:49.206450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:49.207604 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:49.208292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:49.225342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9f64f59f-120e-4d84-a468-a4a5b41492b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 1.630818 Jul 25 19:04:49.226022 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 25/48] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:47 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:49.243426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:49.254788 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:49.261008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:49.261498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:49.267946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:49.269036 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:49.526783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:49.540850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:49.563421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:49.563421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ec83cb4b-89d0-457d-b8d7-682d0bcf3425 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1340 microversion: 2.20 time: 0.377983 Jul 25 19:04:49.574589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:49 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1340 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:49.827175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:49.851962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-42bcbd96-ea93-4cc9-b650-d904c0ea12a5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1293 microversion: 2.1 time: 0.620337 Jul 25 19:04:49.853338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 26/50] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:49 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1293 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:50.197368 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:50.202503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:50.215764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.218494 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:50.220212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:50.221551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:50.222511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:50.258827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:50.260119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:50.277470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=4 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.284196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:50.285865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:50.294702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:50.296080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:50.875811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.904593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:50.942025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-096b40b5-12fc-4e54-bec2-c61c0dfdaf3f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.687710 Jul 25 19:04:50.966848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 27/51] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:50 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:50.966848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:50.966848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:50.975713 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:50.976260 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:50.977060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:50.977840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:51.494932 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:51.557931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6d3ff81c-a16a-43d4-ab7a-5467c318bfa2 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 1.382143 Jul 25 19:04:51.558496 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 25/52] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:50 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:51.569466 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:51.570238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:51.627969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:51.631096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:51.634212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:51.636363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:51.775378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=26 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.863026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:51.899643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b2204cf3-e5b0-4acf-b89c-664718a4b988 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1293 microversion: 2.1 time: 0.339354 Jul 25 19:04:51.934066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 26/53] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:51 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:51.990457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:51.991681 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:52.004823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:52.008238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:52.011722 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:52.012868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:52.760673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:52.806782 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6ed2ac1a-da94-43f2-ba9d-634e7283548d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.820346 Jul 25 19:04:52.830433 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 27/54] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:51 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:52.885868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:52.890071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:52.920189 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:52.922712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:52.928337 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:52.929626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:52.963635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:52.989785 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:52.994020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:53.003398 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-aa7b3c55-e0e7-456f-a078-92cc7d470218 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 2.042784 Jul 25 19:04:53.005598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 28/55] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:50 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:53.034069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:53.037057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:53.073402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:53.079108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:53.086771 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:53.090354 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:54.544472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:54.566664 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=71 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.568747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=26 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.602880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6c71ff3e-ea6c-48ed-b513-4f9c1dd186fe tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 1.745799 Jul 25 19:04:54.619030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 28/56] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:52 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:55.485186 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-d9d6e116-f54f-44ea-8120-3d13c6ea2362 req-3e5b981a-0e8b-45b5-80d6-9834e2103c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bffab6ed-1699-49d7-bee1-73e045f1e868", "tag": "58ad3790-244f-4d95-b9e7-422923ef19fa"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:55.538583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d9d6e116-f54f-44ea-8120-3d13c6ea2362 req-3e5b981a-0e8b-45b5-80d6-9834e2103c3c service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:55.539607 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d9d6e116-f54f-44ea-8120-3d13c6ea2362 req-3e5b981a-0e8b-45b5-80d6-9834e2103c3c service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:55.626700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-d9d6e116-f54f-44ea-8120-3d13c6ea2362 req-3e5b981a-0e8b-45b5-80d6-9834e2103c3c service nova] Creating event network-changed:58ad3790-244f-4d95-b9e7-422923ef19fa for instance bffab6ed-1699-49d7-bee1-73e045f1e868 on hv-cinder-82002 Jul 25 19:04:55.627764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d9d6e116-f54f-44ea-8120-3d13c6ea2362 req-3e5b981a-0e8b-45b5-80d6-9834e2103c3c service nova] Acquired lock "compute-rpcapi-router" {{(pid=125167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 19:04:55.629639 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:55.630401 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:55.658778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:55.664802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:55.739079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.compute.rpcapi [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 19:04:55.740510 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] Releasing lock "compute-rpcapi-router" {{(pid=125167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 19:04:55.788915 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a5bb0077-53e6-45fb-aff5-2cc8fbc0dddc None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.181979 Jul 25 19:04:55.789907 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 29/57] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:55.800191 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:55.818036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:55.845093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:55.845888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:55.847040 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:55.847677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:56.334765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:56.366563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-93936ab3-71cf-493a-8f8d-6e67d74f0a65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 3.359329 Jul 25 19:04:56.397474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 29/58] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:53 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 3390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:56.428661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:56.429908 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:56.440738 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:56.444746 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:56.445710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:56.447803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:56.448676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:57.077346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:57.107848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7dfaed59-11c2-4c63-b3cd-1f21bfc13b28 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 1.312669 Jul 25 19:04:57.107848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 30/59] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:55 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:57.679098 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:57.689819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:57.691587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:57.693089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f045d59d-503d-46d6-af7c-475f851d6817 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 1.295474 Jul 25 19:04:57.702437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 30/60] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:56 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:04:57.702437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:57.702437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:57.710360 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:57.711118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:57.713477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:57.713477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:58.294381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-cad53a4c-3852-4e7a-9a1c-9e88a733c083 req-f348076f-9f19-4bf1-bc78-740250a4976f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3ed71b-85b5-454f-a874-b0f7031ef007", "tag": "c4d00d96-da69-4fe8-988f-496608d9e3c9"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:04:58.332185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-cad53a4c-3852-4e7a-9a1c-9e88a733c083 req-f348076f-9f19-4bf1-bc78-740250a4976f service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:58.333340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-cad53a4c-3852-4e7a-9a1c-9e88a733c083 req-f348076f-9f19-4bf1-bc78-740250a4976f service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:58.359728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-cad53a4c-3852-4e7a-9a1c-9e88a733c083 req-f348076f-9f19-4bf1-bc78-740250a4976f service nova] Creating event network-changed:c4d00d96-da69-4fe8-988f-496608d9e3c9 for instance fd3ed71b-85b5-454f-a874-b0f7031ef007 on hv-cinder-82002 Jul 25 19:04:58.366085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-cad53a4c-3852-4e7a-9a1c-9e88a733c083 req-f348076f-9f19-4bf1-bc78-740250a4976f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.234919 Jul 25 19:04:58.366894 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 31/61] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:04:58.428881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:58.433264 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:58.453333 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:58.465476 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:58.467345 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:58.479287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:58.995389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:59.016035 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-11049b28-ea4a-44b8-a0ae-c104e9396b89 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 1.320035 Jul 25 19:04:59.018565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 31/62] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:57 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:59.026652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:59.028796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:59.097927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:59.098218 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:59.101103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:59.101563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:59.649592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:04:59.679964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c82478a2-c854-45b0-9a84-0d7f1b2923e6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 1.302438 Jul 25 19:04:59.679964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 32/63] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:58 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:59.705379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:04:59.707003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:04:59.733868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:59.737395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:04:59.742496 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:04:59.743647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.062661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:00.071343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:00.074047 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-01297544-bb9e-4bdf-a21a-939c45bb03fd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 1.054633 Jul 25 19:05:00.080499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 32/64] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:04:59 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:00.096315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-8c9436a4-fde2-4e53-bcab-6b2248efecc3 req-66f9b4c3-8181-41ae-9ad8-90dbd08bbc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:00.140759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8c9436a4-fde2-4e53-bcab-6b2248efecc3 req-66f9b4c3-8181-41ae-9ad8-90dbd08bbc59 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.141998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8c9436a4-fde2-4e53-bcab-6b2248efecc3 req-66f9b4c3-8181-41ae-9ad8-90dbd08bbc59 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.221403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-8c9436a4-fde2-4e53-bcab-6b2248efecc3 req-66f9b4c3-8181-41ae-9ad8-90dbd08bbc59 service nova] Creating event network-changed:e40ea0fc-afa9-4060-9acf-75154697423d for instance 455a6d7b-3a62-47e8-8eca-526bc28307de on hv-cinder-82002 Jul 25 19:05:00.222551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8c9436a4-fde2-4e53-bcab-6b2248efecc3 req-66f9b4c3-8181-41ae-9ad8-90dbd08bbc59 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 19:05:00.227250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.229029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.233214 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.233912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.264728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.compute.rpcapi [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 19:05:00.266208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] Releasing lock "compute-rpcapi-router" {{(pid=125166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 19:05:00.316162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c44decef-9c4e-43e8-b963-4b62c46a4d6f None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233772 Jul 25 19:05:00.426597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 33/65] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:00.426597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:00.426597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:00.426597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.426597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.430282 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.430282 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.625426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:00.636768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:00.654838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:00.661486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b76e5cad-78ad-4005-a263-e8f91d6dda20 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.979640 Jul 25 19:05:00.663308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:04:59 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:00.674514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-1ee3fd35-d0e2-4c14-add4-7c581d8f6346 req-82b900a3-5c2d-46a7-9a1f-40640cd63ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ff921d-92b0-4208-b109-9f6969a9b950", "tag": "a30f1989-9491-4874-b4fd-962b93238fb5"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:00.689626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-1ee3fd35-d0e2-4c14-add4-7c581d8f6346 req-82b900a3-5c2d-46a7-9a1f-40640cd63ee1 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.694299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-1ee3fd35-d0e2-4c14-add4-7c581d8f6346 req-82b900a3-5c2d-46a7-9a1f-40640cd63ee1 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.709154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-1ee3fd35-d0e2-4c14-add4-7c581d8f6346 req-82b900a3-5c2d-46a7-9a1f-40640cd63ee1 service nova] Creating event network-changed:a30f1989-9491-4874-b4fd-962b93238fb5 for instance a8ff921d-92b0-4208-b109-9f6969a9b950 on hv-cinder-82002 Jul 25 19:05:00.719209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-1ee3fd35-d0e2-4c14-add4-7c581d8f6346 req-82b900a3-5c2d-46a7-9a1f-40640cd63ee1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051861 Jul 25 19:05:00.721366 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 34/67] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:00.769240 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:00.769240 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:00.841454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.842938 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:00.854681 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:00.860302 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:01.297679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:01.310070 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-30ea056e-daf4-480c-b9d1-78ecbcf3b544 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.571625 Jul 25 19:05:01.318975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 35/68] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:00 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:01.337039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:01.338967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:01.355193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:01.356183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:01.358772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:01.359952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:01.744915 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:01.786573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6da71336-81f7-4206-a692-d0e4b575a220 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.460879 Jul 25 19:05:01.788042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 36/69] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:01 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:01.831589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:01.836624 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:01.845741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:01.846589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:01.848152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:01.848929 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:02.183325 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:02.201746 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dd8349d1-dac0-422f-b922-50c4a668f4d8 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 1.876522 Jul 25 19:05:02.204592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 34/70] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:00 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:02.288046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:02.318677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:02.323236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:02.328663 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e51feb2a-f7d9-4f25-98f4-401caaa90bbc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.538112 Jul 25 19:05:02.330585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 37/71] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:01 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:02.368319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:02.379383 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:02.394360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-989ae915-74f1-4d77-8900-594ead93bbcb req-500c99a5-6773-4572-818b-e7cb519a8112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c66e632-dd5c-4eb5-89fb-ddfe319d4046", "tag": "e4b23594-f162-4f7b-9587-c619dd49ac56"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:02.418938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:02.419644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:02.423758 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-989ae915-74f1-4d77-8900-594ead93bbcb req-500c99a5-6773-4572-818b-e7cb519a8112 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:02.425408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:02.426119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-989ae915-74f1-4d77-8900-594ead93bbcb req-500c99a5-6773-4572-818b-e7cb519a8112 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:02.426499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:02.454674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-989ae915-74f1-4d77-8900-594ead93bbcb req-500c99a5-6773-4572-818b-e7cb519a8112 service nova] Creating event network-changed:e4b23594-f162-4f7b-9587-c619dd49ac56 for instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 on hv-cinder-82002 Jul 25 19:05:02.464907 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-989ae915-74f1-4d77-8900-594ead93bbcb req-500c99a5-6773-4572-818b-e7cb519a8112 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092826 Jul 25 19:05:02.476788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 38/72] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:02.831764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:02.849907 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:02.873038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:02.879935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:02.886971 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:02.888261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:03.068198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:03.096435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5fea62a8-a56f-4b97-9790-28ade34c6a7a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.753998 Jul 25 19:05:03.115180 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 35/73] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:02 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:03.233681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:03.236086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:03.247769 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:03.251640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:03.252723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:03.253322 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:03.386482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:03.403793 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7b924ce0-ac29-43ae-ac36-106ca03ade0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.578127 Jul 25 19:05:03.418903 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:02 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:03.432412 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:03.433544 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:03.445288 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:03.450568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:03.450568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:03.450568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:03.597141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:03.614169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c3e457f6-7ceb-45e8-9b3d-9b132c9d0802 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.384735 Jul 25 19:05:03.615142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 36/75] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:03 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:03.841644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:03.851986 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:03.853765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:03.855044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c9505d34-1419-4abb-86dc-d36bbc4269bd tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.434340 Jul 25 19:05:03.855610 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 40/76] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:03 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:04.155596 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:04.158703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:04.184006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.184006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.184006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.184006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.432574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:04.440621 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:04.443363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:04.464297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b1b7caee-7c76-44c4-9a8b-bdff884d17c5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.297696 Jul 25 19:05:04.464297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 37/77] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:04 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:04.465132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.465132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.465132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.465132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.627753 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:04.638530 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1e77e195-e3f0-4ab4-bdaf-60119d390e7c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.203852 Jul 25 19:05:04.639217 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 41/78] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:04 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:04.643928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:04.644783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:04.656414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.657270 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.658368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.658937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.834468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:04.846377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a7c26455-a261-4772-a086-f29f40ad1ca5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.208742 Jul 25 19:05:04.847299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 38/79] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:04 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:04.899232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:04.900131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:04.907559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.907997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:04.908865 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:04.909881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:05.162862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:05.180266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:05.183406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:05.184800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1694fb86-e7ee-4716-b90f-5e45d73c4209 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.290722 Jul 25 19:05:05.185560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 42/80] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:04 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:05.499673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:05.506709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:05.518496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:05.519191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:05.520684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:05.521439 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:05.668857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:05.672650 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:05.681019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:05.681827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:05.682912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:05.683598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:05.706805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:05.913150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:05.918580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:05.924944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-74a11252-9a66-4cab-bf26-642b9aa903a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.265776 Jul 25 19:05:05.926232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 43/81] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:05 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:05.937878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:05.938959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:05.945811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4e1edaa0-158f-44ce-bcbe-5f8fa0e15a24 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.451448 Jul 25 19:05:05.946696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 39/82] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:05 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:05.948934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:05.949783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:05.951181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:05.951968 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:06.177558 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:06.190248 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f34a6df9-7dce-4826-a194-2dd17e3e3135 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.261238 Jul 25 19:05:06.191253 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 44/83] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:05 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:06.217929 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:06.218662 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:06.226281 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:06.226938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:06.227768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:06.228379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:06.423613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:06.439110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:06.442027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:06.443885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ef796a4c-c934-49b4-8d15-86e243cddb6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.230890 Jul 25 19:05:06.444838 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 40/84] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:06 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:06.958007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:06.958007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:06.974288 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:06.980556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:06.981323 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:06.981469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:06.986294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:06.986294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:06.993423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:06.993899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:06.997714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:06.998512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:07.235594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:07.266197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e24821f8-9d1c-4fbf-a3f9-4ee34372a414 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.317599 Jul 25 19:05:07.267087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 45/85] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:06 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:07.292923 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:07.297532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:07.323289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:07.330594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:07.330594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:07.330594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:07.357504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:07.400783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c4bb9c38-651d-4222-9de7-0aabf797fc88 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.416581 Jul 25 19:05:07.402113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 41/86] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:06 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:07.486693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:07.487337 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:07.495058 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:07.495935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:07.497143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:07.497859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:07.604384 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:07.622876 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-93bfc80b-80a3-42b1-b5cb-81c56752a680 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.349262 Jul 25 19:05:07.623770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 46/87] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:07 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:07.773579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:07.791369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:07.804317 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:07.805528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-52dbd521-bbfc-4a8c-b1bc-aa0272473d9b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.330853 Jul 25 19:05:07.806087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 42/88] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:07 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:08.306829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:08.307961 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:08.318868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.319989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.321493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.322459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.442890 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:08.445394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:08.457994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.459133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.460857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.461862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.535492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:08.538936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:08.557246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e17dbead-4db0-4003-aa38-edb97f05165a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.256323 Jul 25 19:05:08.567953 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 47/89] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:08 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:08.653595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:08.655201 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:08.665304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.665794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.666716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.667203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.700082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:08.712297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f9e0de8d-9e54-44c5-921c-436445de1d5b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.277687 Jul 25 19:05:08.713152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 43/90] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:08 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:08.833594 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:08.835086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:08.846058 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.846837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.848231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:08.849340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:08.863752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:08.889165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8c572e5e-ff25-4a2b-91bc-41efc1ace02e tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.241525 Jul 25 19:05:08.891867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 48/91] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:08 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:09.032821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:09.041924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:09.043586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:09.044757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-da452304-dca4-43c5-b540-351478eb2af6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.218192 Jul 25 19:05:09.045334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 44/92] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:08 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:09.598674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:09.601185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:09.613552 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:09.614485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:09.615991 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:09.617240 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:09.738301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:09.741287 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:09.754838 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:09.755394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:09.756295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:09.756878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:09.993538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:10.002938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d344a964-dec3-4bf8-a845-177924475606 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.269425 Jul 25 19:05:10.012546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:10.018003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 45/93] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:09 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:10.023287 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:10.024201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:10.028361 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-113e4234-0ba6-43bb-8184-d407eccf005a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.437782 Jul 25 19:05:10.033317 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 49/94] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:09 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:10.036076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:10.037000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:10.038511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:10.039653 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:10.069112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:10.069740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:10.079487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:10.079912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:10.080617 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:10.081218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:10.263263 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:10.321524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:10.330534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:10.342874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:10.344134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2b255ce2-6519-4e7a-b2d8-85f5ca3f6305 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.321799 Jul 25 19:05:10.347424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 46/95] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:10 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:10.348050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:10.349363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4e6e46a2-9ac7-42cd-a8fb-94a8560da8e5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.284580 Jul 25 19:05:10.349910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 50/96] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:10 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:11.027203 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:11.027939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:11.036952 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.037405 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.038206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.038667 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.069379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:11.070041 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:11.079107 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.079555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.080420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.080897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.275415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:11.288096 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-78219fa5-38ea-4aa2-8eb0-3f56ba4dcc3e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.265888 Jul 25 19:05:11.288987 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 47/97] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:11 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:11.314628 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:11.323257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0a0a6efe-4c58-4d7c-aa3f-a7459ad1217f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.258553 Jul 25 19:05:11.323834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 51/98] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:11 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:11.377950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:11.384263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:11.385258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:11.391293 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:11.397157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.397904 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.398938 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.399896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.409502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.410458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.411386 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:11.411850 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:11.610734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:11.624603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:11.624603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:11.625803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5400bb6f-c615-4f4a-ab0e-884888fbdf73 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.246027 Jul 25 19:05:11.638917 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 52/99] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:11 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:11.641212 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:11.655315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-232f70b2-e3e1-462c-badb-03a4d776ee56 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.284446 Jul 25 19:05:11.666481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 48/100] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:11 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:12.329502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:12.330689 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:12.340334 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.341072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.342659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.344282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:12.381976 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:12.394427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.394877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.395869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.396466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.606429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:12.611036 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:12.616332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e9948301-4474-47ea-9b29-b9dea2ca5a54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.263237 Jul 25 19:05:12.616917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 49/101] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:12 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:12.657857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:12.658399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:12.665737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.666583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.667783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.668469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.743050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:12.755740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-260733b5-abff-45de-9979-76e3c79eacef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.433824 Jul 25 19:05:12.758344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 53/102] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:12 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:12.772730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:12.777967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:12.796080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.796599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.800785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:12.800785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:12.931311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:12.947627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:12.966556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:12.968919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1101ae83-3dfd-4dc6-8799-54c78e7056d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.315299 Jul 25 19:05:12.971651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 50/103] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:12 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:13.037342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:13.052537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e8ba80d1-7b8f-45ee-ac2d-3b5eaa2fa979 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.289144 Jul 25 19:05:13.053214 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 54/104] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:12 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:13.651498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:13.651498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:13.660281 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:13.660732 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:13.661698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:13.662452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:13.783920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:13.784596 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:13.791387 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:13.791836 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:13.792809 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:13.793244 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:13.906943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:13.919727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d4aa4ccb-72ba-4ca7-bd5a-667240409865 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.273459 Jul 25 19:05:13.920802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 51/105] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:13 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:14.003697 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:14.004439 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:14.015530 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:14.015788 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:14.016740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:14.018673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:14.097010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:14.113319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-509e452d-95d2-4099-a6e2-2dac770b471c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.336043 Jul 25 19:05:14.130405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 55/106] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:13 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:14.130405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:14.130405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:14.136428 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:14.136428 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:14.136428 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:14.136668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:14.258358 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:14.270313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:14.273283 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:14.275209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-00a5f820-1478-4c63-88d5-bcd445bbdc5d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.277241 Jul 25 19:05:14.276131 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 52/107] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:13 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:14.407594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:14.422350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-cebbfa2f-a725-4dd9-abdf-042749821386 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.306072 Jul 25 19:05:14.423470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 56/108] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:14 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:14.947213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:14.947828 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:14.956820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:14.957311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:14.958037 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:14.958667 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.147638 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:15.148178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:15.166501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:15.166501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.166501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:15.166501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.206825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:15.220504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7fa6cf9f-f27a-4392-9582-fce31e0044b8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.276513 Jul 25 19:05:15.222008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 53/109] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:14 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:15.301816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:15.302599 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:15.316116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:15.317695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.319343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:15.326059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.406690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:15.415997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-27ea196b-13a4-4f34-b14b-6bc06534c25f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.272437 Jul 25 19:05:15.416988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:15 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:15.452955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:15.453969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:15.462472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:15.463024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.463940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:15.464447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:15.551548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:15.563369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:15.565388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:15.566891 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dd0f2711-de7a-42ab-9c00-923bddc609ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.269830 Jul 25 19:05:15.568223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 54/111] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:15 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:15.723463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:15.733850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3f3f346a-3cd7-4665-bd4f-a988460f8f3f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.285884 Jul 25 19:05:15.734832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 58/112] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:15 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:16.248847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:16.249600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:16.257318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.257780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.258627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.259155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.428631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:16.441154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-be9d839a-0d9a-4a79-b5ae-bf2e4f1506cd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.196691 Jul 25 19:05:16.442223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 55/113] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:16 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:16.445844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:16.447050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:16.460013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.460870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.462197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.463006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.596521 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:16.597982 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:16.608148 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.610114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.613832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.614904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.669118 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:16.680716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f00f6f69-b0cb-4d82-ac51-89229b59c594 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.242219 Jul 25 19:05:16.694552 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 59/114] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:16 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:16.766079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:16.767137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:16.776755 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.777500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.778485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:16.779061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:16.944445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:16.950382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:16.959521 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:16.962059 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f817703f-2b84-42d8-8aaf-4d0809121def tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.204362 Jul 25 19:05:16.963263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 60/115] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:16 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:16.978590 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:16.980693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e67024e4-b7ea-4251-bc2e-35531f6d647d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.391427 Jul 25 19:05:16.981696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 56/116] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:16 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:17.480558 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:17.482010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:17.492487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:17.492487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:17.493692 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:17.494372 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:17.708574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:17.709346 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:17.722037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:17.726356 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:17.729053 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:17.730305 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:17.730833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:17.738638 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-55cb7632-2e17-4359-af61-adc0ea57ab99 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.264952 Jul 25 19:05:17.739219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 61/117] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:17 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:17.938866 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:17.953935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0491f268-afaa-4a41-879e-d280bfaaba10 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.250132 Jul 25 19:05:17.961904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 57/118] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:17 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:17.997288 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:17.998388 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:18.010198 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.010919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.012170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.012868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.015287 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:18.016314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:18.023986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.024546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.025344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.025804 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.221190 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:18.224556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:18.231222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7ae66bf1-d057-4c47-a9ae-72504f5c6250 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.240981 Jul 25 19:05:18.242678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:18.242678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:18.242678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a1be3c36-0151-4151-acb6-846b487530f0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.229126 Jul 25 19:05:18.242966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 58/119] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:18 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:18.243854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 62/120] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:17 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:18.762220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:18.762897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:18.769030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.769476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.770250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.770714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.972561 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:18.973541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:18.974222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:18.980612 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cc5ccb38-2e2b-4835-b02b-69c2d9d9e7e6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.222486 Jul 25 19:05:18.981360 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 59/121] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:18 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:18.981631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.982093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:18.982913 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:18.983376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:19.152898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:19.163218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-af9a0a6f-34ec-4bbb-a607-41135e8f387f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.193596 Jul 25 19:05:19.176382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 63/122] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:18 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:19.258570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:19.259485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:19.266768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:19.267252 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:19.267511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:19.268127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:19.268322 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:19.268545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:19.276027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:19.276608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:19.277474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:19.277964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:19.299233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.507493 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:19.517789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-efad9891-95b5-4462-8a1f-2a4a17aeb52d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.262938 Jul 25 19:05:19.519495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 60/123] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:19 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:19.522495 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:19.536349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:19.537993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:19.539240 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8315c3c6-599e-4817-b143-07e2e6cc9379 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.277346 Jul 25 19:05:19.540197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 64/124] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:19 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:20.012893 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:20.014122 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:20.031369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.031369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.031369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.031369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.188599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:20.189648 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:20.197770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.201534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:20.205829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.210357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-373960c2-b3ee-44fc-bc95-1705fb83c5c2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.204730 Jul 25 19:05:20.210938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 61/125] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:20 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:20.211770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.212222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.369816 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:20.378754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a0e0acd5-dcf0-441a-b708-f65b55867ccc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.196461 Jul 25 19:05:20.379345 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 65/126] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:20 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:20.544445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:20.545584 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:20.556613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.557366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.558698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.559174 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.576649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:20.577510 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:20.585855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.586695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.587856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:20.588407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:20.754072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:20.764943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f618d795-30d6-4546-b928-1306e0ee3c93 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.227654 Jul 25 19:05:20.766072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 62/127] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:20 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:20.767836 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:20.777677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:20.779700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:20.782068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-340a481f-c9cb-43d7-a98a-149a5e7b60ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.209531 Jul 25 19:05:20.783927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 66/128] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:20 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:21.233911 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:21.235678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:21.243779 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.244511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.245329 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.246192 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.402033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:21.402759 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:21.404886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=84 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.412899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.413700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.414735 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.415170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.441609 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:21.450658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6ce5852e-1d07-4586-9eda-5a3a7f400b0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.221257 Jul 25 19:05:21.451136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 63/129] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:21 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:21.585459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:21.594288 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e140155a-f1cd-4a3a-bbf4-78d3f630db90 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.196568 Jul 25 19:05:21.594902 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 67/130] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:21 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:21.794883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:21.795013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:21.809944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:21.810739 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:21.816650 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.819572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.821137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.822995 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.823461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.824830 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:21.826707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:21.830415 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:22.059491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:22.064924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:22.068488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-439cc246-fb34-44dd-8717-bdf37487e168 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.278868 Jul 25 19:05:22.069119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 64/131] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:21 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:22.075391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:22.077568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:22.079276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-32a4b413-a37e-48d1-8209-382f14927bec tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.273663 Jul 25 19:05:22.079955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 68/132] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:21 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:22.148546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-310c5333-a95a-42ae-a37f-00e6b7312677 req-376de7f4-54c8-45e1-a988-a4130e1c4b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffab6ed-1699-49d7-bee1-73e045f1e868", "name": "network-vif-plugged", "status": "completed", "tag": "58ad3790-244f-4d95-b9e7-422923ef19fa"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:22.160445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-310c5333-a95a-42ae-a37f-00e6b7312677 req-376de7f4-54c8-45e1-a988-a4130e1c4b1a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:22.160896 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-310c5333-a95a-42ae-a37f-00e6b7312677 req-376de7f4-54c8-45e1-a988-a4130e1c4b1a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:22.174282 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-310c5333-a95a-42ae-a37f-00e6b7312677 req-376de7f4-54c8-45e1-a988-a4130e1c4b1a service nova] Creating event network-vif-plugged:58ad3790-244f-4d95-b9e7-422923ef19fa for instance bffab6ed-1699-49d7-bee1-73e045f1e868 on hv-cinder-82002 Jul 25 19:05:22.180782 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-310c5333-a95a-42ae-a37f-00e6b7312677 req-376de7f4-54c8-45e1-a988-a4130e1c4b1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103890 Jul 25 19:05:22.181391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 65/133] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:22.475246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:22.475982 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:22.487256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:22.487256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:22.487256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:22.487256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:22.619918 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:22.620845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:22.629903 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:22.630832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:22.631759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:22.632040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:22.659185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:22.667635 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f9c19861-2267-479f-aed2-aeea32fc712f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.197144 Jul 25 19:05:22.668211 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 69/134] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:22 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:22.782168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:22.790364 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-461315c1-97c5-49f0-8fdc-3102ee8315ba tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.177860 Jul 25 19:05:22.791054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 66/135] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:22 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:23.093677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:23.094374 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:23.104208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.104665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.105458 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.105955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.108845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:23.109805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:23.118588 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.119135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.120145 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.120643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.135545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.304408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:23.313549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8f97e66e-21a9-4639-ab38-41e11f6a7a4d tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.224437 Jul 25 19:05:23.314139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 70/136] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:23 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:23.320922 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:23.333582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:23.335518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:23.338608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bb473d6a-6eae-401e-aa9b-a574f53a702e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.235039 Jul 25 19:05:23.338608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 67/137] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:23 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:23.689745 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:23.690376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:23.696686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.697121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.697933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.698383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.815117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:23.815909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:23.824107 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.824829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.825831 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:23.826963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:23.892208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:23.903568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-225ed7f7-2f4d-465e-8c68-95cfd38c3d1e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.217884 Jul 25 19:05:23.904295 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 71/138] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:23 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:23.991337 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:23.999444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-90e9d878-d858-478b-b479-ec539db8010d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.189798 Jul 25 19:05:24.000079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 68/139] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:23 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:24.336837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:24.337851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:24.346080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:24.346668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:24.347589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:24.348026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:24.363198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:24.366789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:24.370570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:24.371436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:24.372442 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:24.373174 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:24.549674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:24.559674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9032fcae-f035-44f7-9093-e5b4bd5886da tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.227334 Jul 25 19:05:24.560420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 72/140] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:24 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:24.573964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:24.583856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:24.585319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:24.586488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-300548c6-2a67-4284-b36d-83b150ff318d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.228477 Jul 25 19:05:24.587051 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 69/141] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:24 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:24.926131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:24.927002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:24.937176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:24.937176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:24.937176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:24.937176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.029129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:25.029855 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:25.037876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:25.038348 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.039591 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:25.039591 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.085936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:25.097268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b4af9711-94ea-4154-ba46-6a9c84d91488 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.175026 Jul 25 19:05:25.097859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 73/142] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:24 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:25.204676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:25.212383 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-699f2752-8328-4118-b903-1712b2bab8b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.187038 Jul 25 19:05:25.212968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 70/143] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:25 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:25.583442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:25.584061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:25.590791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:25.593997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.593997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:25.593997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.611580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:25.612320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:25.619297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:25.619620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.620412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:25.620888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:25.833850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:25.845291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:25.850632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8429f676-786d-4017-9723-e93a1b6eecfc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.271036 Jul 25 19:05:25.852648 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 74/144] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:25 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:25.866443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:25.869321 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:25.872215 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d0c2deb8-c7ac-4b23-9931-10ba18099c47 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.265291 Jul 25 19:05:25.873330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 71/145] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:25 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:26.118757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:26.119447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:26.127647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.128180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.129322 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.129987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.137748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-7f6fa582-b8a7-4936-8596-098ad0bdbe7c req-4222ea58-4ddc-48a5-ba91-48f14bf912a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "name": "network-vif-plugged", "status": "completed", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:26.152596 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-7f6fa582-b8a7-4936-8596-098ad0bdbe7c req-4222ea58-4ddc-48a5-ba91-48f14bf912a6 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.153619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-7f6fa582-b8a7-4936-8596-098ad0bdbe7c req-4222ea58-4ddc-48a5-ba91-48f14bf912a6 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.173150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-7f6fa582-b8a7-4936-8596-098ad0bdbe7c req-4222ea58-4ddc-48a5-ba91-48f14bf912a6 service nova] Creating event network-vif-plugged:e40ea0fc-afa9-4060-9acf-75154697423d for instance 455a6d7b-3a62-47e8-8eca-526bc28307de on hv-cinder-82002 Jul 25 19:05:26.180936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-7f6fa582-b8a7-4936-8596-098ad0bdbe7c req-4222ea58-4ddc-48a5-ba91-48f14bf912a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048565 Jul 25 19:05:26.181726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 72/146] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:26.237702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:26.238753 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:26.261689 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.262463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.263677 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.264548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.379200 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:26.390659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-316d6711-78b9-4315-b3fd-74762c83ccb8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.275423 Jul 25 19:05:26.392332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 75/147] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:26 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:26.475854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:26.491849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3d3ebd63-cefa-4bad-860c-0af6bdcb77e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.256649 Jul 25 19:05:26.491849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:26 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:26.873524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:26.874768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:26.881950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.882437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.883245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.883842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.917485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:26.918429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:26.928122 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.928821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:26.929879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:26.930437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:27.068990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:27.080032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-88917ef3-c250-4f90-8c7c-45230980b658 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.210698 Jul 25 19:05:27.086942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 76/149] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:26 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:27.163721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:27.173780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:27.175644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:27.177043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-95f5df9e-10a1-4cee-82fc-96056323adcf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.263722 Jul 25 19:05:27.177613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 74/150] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:26 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:27.423352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:27.424001 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:27.430228 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:27.430704 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:27.431482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:27.431913 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:27.525702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:27.526890 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:27.534839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:27.535618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:27.536438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:27.536938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:27.586091 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:27.595643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4d6880e7-5d2f-459f-aaf9-4228ca9ccab3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.176638 Jul 25 19:05:27.596518 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 77/151] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:27 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:27.692651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:27.701164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-94857ede-b751-4405-8a03-452cea10000f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.179623 Jul 25 19:05:27.702062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 75/152] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:27 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:28.108258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:28.109247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:28.115734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.116212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.117090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.117729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.204922 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:28.206205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:28.214077 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.214996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.215989 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.216712 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.338688 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:28.353033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8f07bc19-8c94-4fd2-9362-da69d74ed173 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.244025 Jul 25 19:05:28.353033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 78/153] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:28 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:28.527580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:28.537186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:28.539162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:28.540637 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4436728a-a89f-48bb-ad72-80c1233964bf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.341208 Jul 25 19:05:28.541479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 76/154] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:28 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:28.618993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:28.619697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:28.626732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.627178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.627955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.628387 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.724765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:28.729554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:28.742414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.743054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.745343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:28.745818 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:28.819205 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:28.828703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4dc34c05-e5e3-4736-8e98-f22edcd59892 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.213826 Jul 25 19:05:28.829294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 79/155] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:28 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:28.925013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:28.935426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-39728158-fa2a-44ad-b2f0-2cd5d55b5308 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.215629 Jul 25 19:05:28.936119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 77/156] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:28 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:29.384461 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:29.387824 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:29.403140 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.406134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.407547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.410658 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.567932 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:29.569341 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:29.581931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.582639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.584267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.585092 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.611215 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:29.620398 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-30384d6c-07ab-4a2e-a552-2f10b1e007f9 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.249017 Jul 25 19:05:29.621109 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 80/157] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:29 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:29.785509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:29.794074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:29.795741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:29.797064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b447b7e1-07ce-4dba-bb1b-b0e907216d37 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.235727 Jul 25 19:05:29.797711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 78/158] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:29 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:29.856900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:29.857791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:29.869804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.870281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.871988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.872599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.880198 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:29.961220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:29.962467 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:29.966522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=99 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:29.970737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.971181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:29.972195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:29.972711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:30.150808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:30.162677 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:30.170119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c925f1ff-7e6f-4c2d-967f-cf463ecc6abf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.321279 Jul 25 19:05:30.172449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 81/159] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:29 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:30.182506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b5a6eb9c-1ae7-44a1-8706-1800de372e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.221634 Jul 25 19:05:30.182506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 79/160] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:29 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:30.648769 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:30.649837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:30.673172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:30.676306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:30.685038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:30.685603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:30.784025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-de5e8afe-8fe2-4efe-902e-fa3376756eb5 req-6a8223db-5cee-43b0-a93e-1e98d255f8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3ed71b-85b5-454f-a874-b0f7031ef007", "name": "network-vif-plugged", "status": "completed", "tag": "c4d00d96-da69-4fe8-988f-496608d9e3c9"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:30.807374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-de5e8afe-8fe2-4efe-902e-fa3376756eb5 req-6a8223db-5cee-43b0-a93e-1e98d255f8a3 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:30.808246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-de5e8afe-8fe2-4efe-902e-fa3376756eb5 req-6a8223db-5cee-43b0-a93e-1e98d255f8a3 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:30.825730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-de5e8afe-8fe2-4efe-902e-fa3376756eb5 req-6a8223db-5cee-43b0-a93e-1e98d255f8a3 service nova] Creating event network-vif-plugged:c4d00d96-da69-4fe8-988f-496608d9e3c9 for instance fd3ed71b-85b5-454f-a874-b0f7031ef007 on hv-cinder-82002 Jul 25 19:05:30.836209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-de5e8afe-8fe2-4efe-902e-fa3376756eb5 req-6a8223db-5cee-43b0-a93e-1e98d255f8a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056031 Jul 25 19:05:30.836973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 80/161] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:30.846877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:30.846877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:30.856139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:30.856584 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:30.858186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:30.858186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:30.919764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:30.940743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3a93a1a2-74ce-491d-a70c-b30bc1e62056 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.295525 Jul 25 19:05:30.942484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 82/162] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:30 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:31.080030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:31.094953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:31.098065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:31.100198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2c33e5c0-8d36-444d-a4b6-70701a3aa393 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.261229 Jul 25 19:05:31.101213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 81/163] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:30 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:31.221790 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:31.222011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:31.226898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:31.228311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:31.235601 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:31.236548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:31.238097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:31.239633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:31.239955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:31.240408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:31.241332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:31.241764 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:31.422124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:31.432260 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3e055939-432a-4bd4-b0c3-f4519d7335ef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.213044 Jul 25 19:05:31.432888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 82/164] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:31 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:31.461486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:31.472438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-015f31dd-cb07-441c-bc2e-5b29e63740c9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.260151 Jul 25 19:05:31.475840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 83/165] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:31 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:31.991671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:31.994201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:32.014835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:32.016829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:32.020178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:32.021427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:32.147863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:32.149231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:32.187571 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:32.188313 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:32.199193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:32.199957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:32.851755 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:32.878405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:32.891358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:32.891578 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-30e3dae6-fb9a-4c3a-bd34-52772e5c3ba7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.758477 Jul 25 19:05:32.900140 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 84/166] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:32 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:32.932571 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:32.935510 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:32.943791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:32.944517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:32.945761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:32.947188 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:33.205995 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:33.212784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:33.214360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d632f302-b7ee-4056-abe1-d6151e70195e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.312593 Jul 25 19:05:33.223163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-36aad14f-7cdd-4471-8446-a0b12bc3d731 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 1.246973 Jul 25 19:05:33.228495 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 85/167] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:32 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:33.235016 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 83/168] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:31 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:33.239004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:33.239959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:33.246606 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:33.247064 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:33.250551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:33.250551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:33.693226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:33.702763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8af1468c-ccd3-4982-911c-6dad134c66a6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.469126 Jul 25 19:05:33.704156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 86/169] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:33 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:33.931068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:33.932518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:33.949595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:33.950311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:33.953164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:33.955407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.180082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:34.191143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:34.194825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:34.197522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d773d54d-d747-48a9-b064-57ed8e57d5a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.273367 Jul 25 19:05:34.198606 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 84/170] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:33 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:34.241604 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:34.243541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:34.253096 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:34.253847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:34.258823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:34.259801 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.260592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:34.261058 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.274575 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:34.275474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.276986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:34.277960 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.289113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.450847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:34.467908 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-18f67e60-631e-4836-98eb-d171fc06af9c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.230882 Jul 25 19:05:34.469093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 87/171] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:34 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:34.486549 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:34.499289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b352d4d5-cf08-4f17-b210-3af0b996dc0b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.249857 Jul 25 19:05:34.500224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 85/172] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:34 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:34.731415 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:34.732026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:34.742945 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:34.743266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.744044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:34.744472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:34.918830 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:34.927826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2400a30a-2194-4944-9dd0-206bd4c577e4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.200114 Jul 25 19:05:34.940537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 88/173] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:34 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:35.238805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:35.239974 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:35.246941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.247267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.248027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.248490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.415279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:35.425854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:35.427554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:35.437671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dced984e-9152-4062-8374-b8d5c92072c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.195648 Jul 25 19:05:35.438565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 86/174] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:35 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:35.497479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:35.498111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:35.504949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.505365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.506139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.506613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.524402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:35.525126 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:35.533973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.534562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.535468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.535939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.684984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:35.698474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-27d37e5c-0f13-43b4-aa9c-348c5313be11 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.205014 Jul 25 19:05:35.702496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:35.709833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 89/175] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:35 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:35.712021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-10e4894d-8cec-4265-8656-a099015cc31c tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.191521 Jul 25 19:05:35.713029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 87/176] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:35 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:35.953361 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:35.954127 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:35.960366 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.961095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:35.962042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:35.962793 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.121047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:36.138928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-91963274-c777-482d-b637-3639d705e264 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.189957 Jul 25 19:05:36.140126 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 90/177] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:35 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:36.462422 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:36.463155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:36.472400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:36.473189 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.474026 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:36.474704 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.660442 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:36.669796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:36.672000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:36.673147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-09337fb9-fe1e-4d71-9de1-2075cc3add2c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.215299 Jul 25 19:05:36.673792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 88/178] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:36 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:36.728329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:36.728936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:36.734547 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:36.735424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:36.736346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:36.736993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.737981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:36.738798 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.745754 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:36.746216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.748678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:36.749469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:36.913806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:36.923993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-27fde86e-bfba-4a21-88d8-beb9dabbe980 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.199991 Jul 25 19:05:36.924584 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 91/179] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:36 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:36.979078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:36.989224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-acf68bec-87fb-4419-8776-a86371d9aa7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.258208 Jul 25 19:05:36.989224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 89/180] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:36 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:37.176582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:37.176582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:37.183210 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:37.183953 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:37.184876 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:37.185444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:37.376724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:37.385983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ebbe2162-b3ef-4a0f-b938-6e2c1171737d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.215604 Jul 25 19:05:37.386625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 92/181] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:37 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:37.696952 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:37.697923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:37.704016 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:37.704594 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:37.705708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:37.705931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:37.912036 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:37.924041 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:37.925659 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:37.926966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3eeca833-a891-4a6b-a19f-a3f80953d0fa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.234314 Jul 25 19:05:37.927512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 90/182] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:37 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:37.947330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:37.951576 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:37.955195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:37.955654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:37.956407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:37.956835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:38.023450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:38.024069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:38.035006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:38.036431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:38.037306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:38.037757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:38.118228 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:38.129136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b5cd43ec-a4c0-46a9-8a60-6e3a32561167 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.185227 Jul 25 19:05:38.140403 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 93/183] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:37 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:38.220845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:38.229465 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1cb2fce6-1f81-4093-83d1-65cc6de87bc7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.209848 Jul 25 19:05:38.230167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 91/184] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:38 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:38.409263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:38.410810 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:38.425775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:38.425775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:38.425775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:38.425775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:38.572356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:38.584223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ef4b607e-d3a6-4589-93d3-cb90751bd091 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.179866 Jul 25 19:05:38.584942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 94/185] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:38 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:38.950964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:38.952627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:38.959452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:38.959925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:38.960733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:38.961188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.101861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:39.113138 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:39.115967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:39.118209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b8e99df2-030e-4f45-88b6-bd43928dc6e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.170789 Jul 25 19:05:39.119304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 92/186] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:38 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:39.161323 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:39.162106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:39.168855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:39.169299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.170073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:39.171232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.253187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:39.254005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:39.261276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:39.261728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.262552 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:39.262991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.325843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:39.334099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e46310b9-81d6-4178-8d39-c77b8b5b7080 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.177122 Jul 25 19:05:39.345944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 95/187] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:39 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:39.461518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:39.470259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8f8b5257-44c1-401f-a955-666829609677 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.221891 Jul 25 19:05:39.471223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 93/188] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:39 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:39.611924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:39.612416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:39.618916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:39.619359 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.620129 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:39.620566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:39.760470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:39.769145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f639e4ee-be26-438c-b8f9-8ef3a31a36e9 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.162086 Jul 25 19:05:39.772077 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 96/189] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:39 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:40.146546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:40.150250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:40.158747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.159302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.160159 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.161262 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.181627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-f38fc847-81d4-4690-a322-40483b7ea50d req-ac6e13c6-a2d0-4d1e-834b-e1c6a436605c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ff921d-92b0-4208-b109-9f6969a9b950", "name": "network-vif-plugged", "status": "completed", "tag": "a30f1989-9491-4874-b4fd-962b93238fb5"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:40.192855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-f38fc847-81d4-4690-a322-40483b7ea50d req-ac6e13c6-a2d0-4d1e-834b-e1c6a436605c service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.193383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-f38fc847-81d4-4690-a322-40483b7ea50d req-ac6e13c6-a2d0-4d1e-834b-e1c6a436605c service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.207187 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-f38fc847-81d4-4690-a322-40483b7ea50d req-ac6e13c6-a2d0-4d1e-834b-e1c6a436605c service nova] Creating event network-vif-plugged:a30f1989-9491-4874-b4fd-962b93238fb5 for instance a8ff921d-92b0-4208-b109-9f6969a9b950 on hv-cinder-82002 Jul 25 19:05:40.212778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-f38fc847-81d4-4690-a322-40483b7ea50d req-ac6e13c6-a2d0-4d1e-834b-e1c6a436605c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035421 Jul 25 19:05:40.213395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 97/190] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:40.319117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:40.329543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:40.331897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:40.333175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6de35280-9753-4cfc-a45c-87878e38ace5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.191927 Jul 25 19:05:40.333715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 94/191] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:40 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:40.357566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:40.358485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:40.365107 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.365544 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.367815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.368268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.385922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.495162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:40.496049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:40.504724 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.505535 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.511704 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.511704 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.539755 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:40.548330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-54f26d22-92a0-4f28-ab24-a5b23ae64ffd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.194921 Jul 25 19:05:40.549926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 98/192] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:40 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:40.684674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:40.693745 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2cdba60a-1a2b-4a2a-9751-25da09fb52ca tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.203553 Jul 25 19:05:40.694353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 95/193] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:40 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:40.791556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:40.792260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:40.799425 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.799870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.800654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:40.801092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:40.971118 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:40.980192 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-364f406b-7f75-4569-a13d-e9d68cbaac1b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.193171 Jul 25 19:05:40.981097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 99/194] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:40 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:41.357072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:41.358363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:41.370440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:41.370993 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:41.371810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:41.372244 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:41.517931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:41.527910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:41.530622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:41.532012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4fe34680-348a-4007-b09d-73e21a3d61ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.179819 Jul 25 19:05:41.532589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 96/195] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:41 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:41.575265 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:41.575883 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:41.584123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:41.584123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:41.584924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:41.585351 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:41.719364 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:41.719364 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:41.724836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:41.725464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:41.726415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:41.727049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:41.745000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:41.757019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-29e324ab-632a-4a77-9946-a696ca3a8516 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.185858 Jul 25 19:05:41.759464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 100/196] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:41 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:41.914001 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2080883389", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "networks": [{"uuid": "dbccd2f8-6687-4a50-9cd2-a6a34be80480"}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:41.936629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:41.950198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4db732c2-297e-4958-8113-3dacca7d3fa5 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.237836 Jul 25 19:05:41.951592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 97/197] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:41 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:41.996100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] validate_networks() for [('dbccd2f8-6687-4a50-9cd2-a6a34be80480', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:05:42.004826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:42.005438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:42.012793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.013285 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.014964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.015193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.223800 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:42.234942 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d413ce6d-fe8a-4625-92c1-083fbdd02054 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.234271 Jul 25 19:05:42.235443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 98/198] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:41 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:42.471634 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:05:42.472259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:05:42.472825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:05:42.473258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:05:42.473848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:05:42.485185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.485546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.486371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.486841 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.512342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Getting quotas for project 9062c0ee33bb464c88d5f5e7471c6961. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:05:42.520286 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Getting quotas for user 8d04f1378edc435a801a6c2719ec31f5 and project 9062c0ee33bb464c88d5f5e7471c6961. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:05:42.534086 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:05:42.537233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:05:42.558775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:42.559477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:42.567138 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.567461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.568500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.568954 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.687961 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f3f46493-214d-4c41-b4ca-b1f2b7e3eff3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777619 Jul 25 19:05:42.694877 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 101/199] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:05:42.702022 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-47d681ec-32f1-42cc-b611-457f9556943c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:42.702747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-47d681ec-32f1-42cc-b611-457f9556943c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:42.734382 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:42.753038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:42.754702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:42.757248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-27fd077d-c9f8-478b-8b83-61884e7016c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.204993 Jul 25 19:05:42.771127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 99/200] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:42 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:42.771583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-47d681ec-32f1-42cc-b611-457f9556943c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:42.780734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-47d681ec-32f1-42cc-b611-457f9556943c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1214 microversion: 2.1 time: 0.084106 Jul 25 19:05:42.782073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 102/201] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:42 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:42.798144 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:42.799324 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:42.808993 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.809955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.811208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.811208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.979053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:42.980540 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:42.984653 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:42.989142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.989684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.990529 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:42.998117 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:42.998393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2db17f46-2632-4d3e-9635-bdca1b038fce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.219126 Jul 25 19:05:42.998393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 100/202] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:42 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:43.148043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:43.159077 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2b719ff3-c242-40c0-b07f-708d24806988 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.185359 Jul 25 19:05:43.160080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 103/203] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:42 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:43.266775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:43.266775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:43.280956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:43.282504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:43.282504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:43.284985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:43.484671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:43.497193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.515432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c3c1354a-7d74-4f0f-8fd9-3cca1b59889f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.241248 Jul 25 19:05:43.516473 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 101/204] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:43 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:43.781618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:43.782534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:43.789242 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:43.789690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:43.790691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:43.791137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:43.811721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-957c328d-ab80-4cfb-bc65-6340d11ccc35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:43.812813 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-957c328d-ab80-4cfb-bc65-6340d11ccc35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:43.893503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-957c328d-ab80-4cfb-bc65-6340d11ccc35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:43.902314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-957c328d-ab80-4cfb-bc65-6340d11ccc35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1214 microversion: 2.1 time: 0.098752 Jul 25 19:05:43.903995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 102/205] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:43 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:44.011400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:44.021054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:44.021423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:44.024626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:44.024885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:44.024885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3c93a926-0ac3-4d28-ab0b-514b41e4d674 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.246725 Jul 25 19:05:44.024885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 104/206] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:43 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:44.031067 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.031518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.032347 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.032778 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.182698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:44.185613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:44.191783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.192076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.193058 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.193597 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.227007 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:44.236961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2003fbe6-2344-4075-ac47-9487d1d986a8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.219671 Jul 25 19:05:44.237718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 103/207] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:44 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:44.355004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:44.363934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9f62dbb1-da60-4fb9-8b83-58cb882f89c4 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.186476 Jul 25 19:05:44.364522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 105/208] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:44 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:44.543251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:44.544799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:44.554253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.554999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.556108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.556713 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.736145 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:44.745431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0fac0884-ef6b-46e0-85ba-8c2f97e3fa13 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.207041 Jul 25 19:05:44.746009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 104/209] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:44 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:44.802810 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-93fdf37b-2359-4af5-9d07-a06d1c9267dd req-e4be97aa-3fe1-459c-a9a0-f7aabb37afd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c66e632-dd5c-4eb5-89fb-ddfe319d4046", "name": "network-vif-plugged", "status": "completed", "tag": "e4b23594-f162-4f7b-9587-c619dd49ac56"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:44.821078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-93fdf37b-2359-4af5-9d07-a06d1c9267dd req-e4be97aa-3fe1-459c-a9a0-f7aabb37afd1 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.821502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-93fdf37b-2359-4af5-9d07-a06d1c9267dd req-e4be97aa-3fe1-459c-a9a0-f7aabb37afd1 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.835741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-93fdf37b-2359-4af5-9d07-a06d1c9267dd req-e4be97aa-3fe1-459c-a9a0-f7aabb37afd1 service nova] Creating event network-vif-plugged:e4b23594-f162-4f7b-9587-c619dd49ac56 for instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 on hv-cinder-82002 Jul 25 19:05:44.841806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-93fdf37b-2359-4af5-9d07-a06d1c9267dd req-e4be97aa-3fe1-459c-a9a0-f7aabb37afd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042804 Jul 25 19:05:44.842928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 106/210] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:44.929625 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:44.930359 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:44.938068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.938544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:44.939477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:44.939922 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.015250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:45.025304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bda6a548-34e3-414e-8fd3-ea24ae61d50d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1218 microversion: 2.1 time: 0.099939 Jul 25 19:05:45.025937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 105/211] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:44 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:45.050224 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:45.051615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:45.057926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.058484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.059259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.059696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.217201 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:45.226137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:45.227694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:45.228897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-818ccaf2-2dab-47e4-afc2-4bae8afea162 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.183125 Jul 25 19:05:45.229442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 107/212] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:45 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:05:45.259292 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:45.259897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:45.266244 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.266725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.267490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.267917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.386016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:45.388037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:45.393569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.393754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.395056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.395218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.417686 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:45.431935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-572c11a2-00aa-4720-baab-14ffbb09cc74 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.176675 Jul 25 19:05:45.432633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 106/213] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:45 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:45.603006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:45.612465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4b969999-8166-443c-b61d-b0ddde9f9940 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.231439 Jul 25 19:05:45.613336 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 108/214] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:45 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:45.769867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:45.771177 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:45.778399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.779995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:45.781070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:45.781733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.031044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.044006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b94e111d-00a0-4314-9a79-1a08495f09a7 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.279099 Jul 25 19:05:46.044567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 107/215] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:45 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:46.063930 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:46.064555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:46.071452 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.082690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.084627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.084627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.085283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.157895 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.166659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-30377bc8-3515-4652-b82e-d7469ca08819 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1218 microversion: 2.1 time: 0.123002 Jul 25 19:05:46.167264 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 109/216] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:46 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:46.252874 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:46.253482 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:46.260402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.261207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.261993 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.262454 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.423216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.434226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.436551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.439883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-057ab16e-4934-4891-aa0d-ae642219ed68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1408 microversion: 2.20 time: 0.189419 Jul 25 19:05:46.448274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 108/217] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:46 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:46.458418 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:46.459411 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:46.483115 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.483800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.484775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.485398 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.640656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:46.641474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:46.650690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.651238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.651777 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.653557 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:46.654652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:46.662976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d8d4b30f-9c9b-4213-b6bc-45d385d61c8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.209110 Jul 25 19:05:46.663710 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 110/218] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:46 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:46.851952 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:46.867900 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d9998d21-7f3a-4c5d-939e-22ff74ab0ec7 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1315 microversion: 2.1 time: 0.236308 Jul 25 19:05:46.868941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 109/219] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:46 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:47.073713 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:47.075303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:47.085556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.087120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.088694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.089420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.193236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:47.196535 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:47.208119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.209100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.211073 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.211730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.304453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:47.317308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-deabacf5-d736-47c3-88cc-55eaadf6bb35 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1210 microversion: 2.1 time: 0.131501 Jul 25 19:05:47.318666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 110/220] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:47 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:47.371367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:47.385832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8d4fee8d-a4dd-4116-aedc-968afdb2cb4e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.320045 Jul 25 19:05:47.387283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 111/221] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:47 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:47.466950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:47.469008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:47.476185 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.476582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.477716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.478523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.651208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:47.660939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:47.662497 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:47.663684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-42ac3062-441e-4a4e-8568-db54b84589fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1600 microversion: 2.20 time: 0.201699 Jul 25 19:05:47.664331 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 111/222] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:05:47 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1600 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:05:47.692255 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:47.697018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:47.702833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:47.703438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:47.714731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.718733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.718733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.719640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.724723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.725465 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.726439 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:47.726888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:47.982306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a7752149-982c-4b22-b1bf-36e153ec01f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.297210 Jul 25 19:05:47.987030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 112/223] 10.222.0.17 () {60 vars in 1316 bytes} [Mon Jul 25 19:05:47 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:05:48.000043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:48.009760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:48.024514 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:48.031876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:48.033605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:48.044356 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:48.046462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:48.067440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-67362ed0-12d9-4e01-a05c-dbe308083c5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.384901 Jul 25 19:05:48.068182 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 112/224] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:47 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:48.347199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:48.347941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:48.366489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:48.368630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:48.385947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:48.386774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:48.488868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:48.507270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6de9b346-d062-47df-a411-80650469c733 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1266 microversion: 2.1 time: 0.165834 Jul 25 19:05:48.510533 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 113/225] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:48 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:48.518081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:48.518941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:48.530247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:48.530926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:48.531865 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:48.532497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:48.687683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:48.703561 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9a947b16-4de8-49b5-8cda-beff3f22ec76 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1501 microversion: 2.1 time: 0.708828 Jul 25 19:05:48.727683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 113/226] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:47 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1501 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:48.801644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:48.821743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-81b48a9f-922c-444e-bea6-9612ffc2eabb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.309778 Jul 25 19:05:48.823280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 114/227] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:48 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:49.105227 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:49.106240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:49.115892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:49.116519 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:49.117700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:49.118247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:49.532757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:49.533492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:49.540381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:49.540924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:49.541582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:49.542110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:49.624275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:49.632607 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-50b80b38-b929-46f0-981f-c1c3c25221d7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1284 microversion: 2.1 time: 0.104936 Jul 25 19:05:49.633221 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 115/228] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:49 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:49.637025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:49.655014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-523c01cd-57f1-4781-a6b5-36f646a77643 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.555778 Jul 25 19:05:49.655783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 114/229] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:49 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:49.857332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:49.859906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:49.873520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:49.882267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:49.883127 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:49.886430 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:50.046464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:50.059656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7a7a2a33-4e73-45fc-885a-d733405a6b99 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.215480 Jul 25 19:05:50.060500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 116/230] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:49 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:50.340007 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-55e5536b-a34b-49b7-adac-09f851d50d37 req-8932df07-f46d-41f3-ba37-03823f6386fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:50.350866 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-55e5536b-a34b-49b7-adac-09f851d50d37 req-8932df07-f46d-41f3-ba37-03823f6386fa service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:50.351310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-55e5536b-a34b-49b7-adac-09f851d50d37 req-8932df07-f46d-41f3-ba37-03823f6386fa service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:50.364889 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-55e5536b-a34b-49b7-adac-09f851d50d37 req-8932df07-f46d-41f3-ba37-03823f6386fa service nova] Creating event network-changed:e40ea0fc-afa9-4060-9acf-75154697423d for instance 455a6d7b-3a62-47e8-8eca-526bc28307de on hv-cinder-82002 Jul 25 19:05:50.370504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-55e5536b-a34b-49b7-adac-09f851d50d37 req-8932df07-f46d-41f3-ba37-03823f6386fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034130 Jul 25 19:05:50.371255 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 115/231] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:50.655586 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:50.656880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:50.665020 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:50.665833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:50.666939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:50.667438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:50.687071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:50.688301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:50.700179 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:50.703505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:50.704694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:50.705430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:50.718525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.912851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:50.927379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-183e2768-2404-4988-9660-a3523fff803f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1272 microversion: 2.1 time: 0.276050 Jul 25 19:05:50.942585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 117/232] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:50 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:50.967402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:50.978585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7cf7eaa7-6147-4e92-9b06-95e59d8f1a4f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.296283 Jul 25 19:05:50.979990 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 116/233] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:50 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:51.091622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:51.092417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:51.099407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:51.100351 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:51.101439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:51.102319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:51.676098 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:51.686058 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dfa7532b-1823-4645-a445-a82a09516360 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1361 microversion: 2.1 time: 0.603845 Jul 25 19:05:51.687128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 118/234] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:51 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1361 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:51.966020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:51.969125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:51.988384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:51.993664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:51.997796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.000865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.006304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:52.010095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:52.024298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.025076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.026364 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.027068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.264435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:52.275593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e184fc7f-a25b-4658-90bd-beead407eb11 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.317791 Jul 25 19:05:52.276620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 117/235] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:51 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:52.289619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b753fa81-1af2-49a6-aeda-32f3051f6dca"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:52.292550 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:52.304448 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.305247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.306471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.311065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:52.314186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.336561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-93ece582-0395-42b3-8ce1-33fbefa768ba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1322 microversion: 2.1 time: 0.338237 Jul 25 19:05:52.346485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 119/236] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:51 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:52.719316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:52.721918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:52.726046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.741063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.747255 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.752274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:52.752716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:52.793720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=8 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.296019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:53.316356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-25ac5ef7-c2e1-41c3-bc66-61e7dc96d129 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1547 microversion: 2.1 time: 0.611334 Jul 25 19:05:53.321910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 120/237] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:52 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1547 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:53.329712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:53.330583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:53.342750 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:53.343716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:53.345078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:53.346302 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:53.658287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:53.667319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-573d8501-e0c6-40f7-aec7-6008f6361bdd tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.343776 Jul 25 19:05:53.667899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 121/238] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:53 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:53.694095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:53.694394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:53.703649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:53.703799 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:53.704535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:53.704977 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:53.725577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0c732bf2-2e13-4550-9bdd-f2afea77e01b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "POST /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.441620 Jul 25 19:05:53.726192 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 118/239] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:05:52 2022] POST /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007/os-volume_attachments => generated 194 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:53.747538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:53.757054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:53.791458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:53.796147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:53.802666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:53.803421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:53.817877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.901620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.940846 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d501ffbc-12c3-4a07-a01e-281784e52c65 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.258226 Jul 25 19:05:53.952279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 122/240] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:05:53 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:54.201420 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:54.206921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-63d50a6b-7b5c-4591-b60a-e33a88cbb841 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1517 microversion: 2.1 time: 0.479364 Jul 25 19:05:54.208233 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 119/241] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:53 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1517 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:54.235637 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-84265cd9-1ea0-4165-b5e1-378e3e8c76cc req-06707716-6ccd-4dac-a1cc-62fc1ab6e399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533a38f0-cdb6-410e-848f-de5a389cb502", "tag": "04e8bc93-ceba-4008-899e-d3dc6112d7e7"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:54.244501 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:54.253055 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:54.260512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-84265cd9-1ea0-4165-b5e1-378e3e8c76cc req-06707716-6ccd-4dac-a1cc-62fc1ab6e399 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.262518 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-84265cd9-1ea0-4165-b5e1-378e3e8c76cc req-06707716-6ccd-4dac-a1cc-62fc1ab6e399 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:54.271046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.275213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:54.275213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.275213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:54.286046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-84265cd9-1ea0-4165-b5e1-378e3e8c76cc req-06707716-6ccd-4dac-a1cc-62fc1ab6e399 service nova] Creating event network-changed:04e8bc93-ceba-4008-899e-d3dc6112d7e7 for instance 533a38f0-cdb6-410e-848f-de5a389cb502 on hv-cinder-82002 Jul 25 19:05:54.292599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-84265cd9-1ea0-4165-b5e1-378e3e8c76cc req-06707716-6ccd-4dac-a1cc-62fc1ab6e399 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070088 Jul 25 19:05:54.293864 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 123/242] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:05:54.326615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'flavor' on Instance uuid a8ff921d-92b0-4208-b109-9f6969a9b950 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:05:54.691284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:54.692430 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:54.702395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.702969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:54.704108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.704916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:54.804254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f9511010-c005-4983-9fc7-0f2fddb563d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950/action" status: 200 len: 32 microversion: 2.1 time: 0.573538 Jul 25 19:05:54.825527 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 120/243] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:05:54 2022] POST /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950/action => generated 32 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:05:54.846185 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:54.847635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:54.862977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.863544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:54.873072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:54.873072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:55.050429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:55.065916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bca2c23f-d176-4a93-b25c-0ae97f0491b0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.379753 Jul 25 19:05:55.067445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 124/244] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:54 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:55.115440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:55.135758 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c06cc0bb-d0e3-47e8-8e3f-94b1498b04c6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.316036 Jul 25 19:05:55.151991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 121/245] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:54 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:55.983266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-1957c00a-5d5a-4daa-a91f-f2b8509d9ae0 req-5c52b909-e51f-4b6f-89ec-d939c41bb32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c66e632-dd5c-4eb5-89fb-ddfe319d4046", "tag": "e4b23594-f162-4f7b-9587-c619dd49ac56"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:05:55.997719 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-1957c00a-5d5a-4daa-a91f-f2b8509d9ae0 req-5c52b909-e51f-4b6f-89ec-d939c41bb32e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:55.998373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-1957c00a-5d5a-4daa-a91f-f2b8509d9ae0 req-5c52b909-e51f-4b6f-89ec-d939c41bb32e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:56.019885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-1957c00a-5d5a-4daa-a91f-f2b8509d9ae0 req-5c52b909-e51f-4b6f-89ec-d939c41bb32e service nova] Creating event network-changed:e4b23594-f162-4f7b-9587-c619dd49ac56 for instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 on hv-cinder-82002 Jul 25 19:05:56.028482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-1957c00a-5d5a-4daa-a91f-f2b8509d9ae0 req-5c52b909-e51f-4b6f-89ec-d939c41bb32e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054245 Jul 25 19:05:56.029994 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 125/246] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:05:56.105036 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:56.105797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:56.114639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:56.114639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:56.115937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:56.115937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:56.270874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:56.270874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:56.270874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:56.270874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:56.274531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:56.274531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:56.364556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:56.379224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f6d63679-0fbd-497d-9b01-567ab9149148 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.278003 Jul 25 19:05:56.380432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 122/247] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:56 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:56.457301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:56.465888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-40a1aa6a-2618-4c27-8c22-b12582e6c663 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.295949 Jul 25 19:05:56.466505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 126/248] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:56 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:57.410853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:57.411722 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:57.419589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:57.420316 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:57.421277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:57.422052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:57.488845 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:57.489942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:57.505530 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:57.505768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:57.506729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:57.507309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:57.700443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:57.737091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6f5ee0a1-597a-48c3-a16e-c8cf867fbe3a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.331293 Jul 25 19:05:57.742999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 123/249] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:57 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:57.828480 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:57.839222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e0f138a7-cb71-4410-84ed-0dd44ad2c5dc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.353502 Jul 25 19:05:57.839644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 127/250] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:57 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:58.822835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:58.826353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:58.859532 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:58.861284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:58.862964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:05:58.863923 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:05:58.864259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:58.865397 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:58.881190 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:58.885677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:58.885677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:05:58.885677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:05:59.207408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:59.222810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-72c05628-e096-4034-a205-6ab8e4f03a37 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.434753 Jul 25 19:05:59.224685 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 124/251] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:58 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:59.342144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:05:59.350724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-742b9ce0-6136-4b4e-b35c-6d81ba24392a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.491906 Jul 25 19:05:59.351655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 128/252] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:05:58 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:00.246302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:00.246952 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:00.257658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:00.258679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:00.260008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:00.260735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:00.378293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:00.379072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:00.386847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:00.391426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:00.391426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:00.391426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:00.457003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:00.466659 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-db9811cb-1e18-4d45-a0d9-8a4adb802cef tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.223860 Jul 25 19:06:00.467660 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 125/253] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:00 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:00.575564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:00.585130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ba5c397e-d69e-4caa-a57f-9ca461c3eedd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.212910 Jul 25 19:06:00.585783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 129/254] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:00 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:01.495257 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:01.496083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:01.499050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=95 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.504733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:01.505181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:01.505971 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:01.506438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:01.613150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:01.614726 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:01.621741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:01.622310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:01.624172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:01.624316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:01.655080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:01.663646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2d09d2e0-5f27-4280-bc4d-2fd96653e281 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.172445 Jul 25 19:06:01.664313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 126/255] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:01 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:01.801487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:01.815015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-48c8bf32-8742-4b33-bfb6-f76abbc7084a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.204458 Jul 25 19:06:01.815015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 130/256] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:01 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:02.689978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:02.690784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:02.697630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:02.698074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:02.698882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:02.699303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:02.836990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:02.838717 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:02.848301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:02.849178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:02.849987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:02.850453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:02.871546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:02.886558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f96b84c2-95f0-4b15-af3a-a9ea45a4ac29 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.201644 Jul 25 19:06:02.887873 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 127/257] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:02 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:03.096261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:03.106839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4b001a3f-2a82-4f8c-bae6-2fe9e2104ef8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.274457 Jul 25 19:06:03.107560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 131/258] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:02 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:03.915893 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:03.916443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:03.925215 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:03.925830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:03.926935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:03.927502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:04.103014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:04.117086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f0512525-14e0-4124-b34a-370f69b169c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.203677 Jul 25 19:06:04.117086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 128/259] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:03 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:04.130963 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:04.131729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:04.140340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:04.141682 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:04.142236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:04.143114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:04.330166 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:04.338784 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1002eb36-32f5-42a1-8f98-5e0a3e385ccc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.212999 Jul 25 19:06:04.339525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 132/260] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:04 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:05.158313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:05.161854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:05.173371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:05.174001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:05.174978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:05.175601 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:05.333599 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:05.342259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-91bdc3c4-7f76-41e8-9ca1-97a3780dce8d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.192785 Jul 25 19:06:05.342884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 129/261] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:05 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:05.376975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:05.378073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:05.386035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:05.386837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:05.387656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:05.388081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:05.551105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:05.561686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bd96d568-6c32-4b8e-b906-d4a795b07aef tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.191460 Jul 25 19:06:05.562521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 133/262] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:05 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:06.365651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:06.366443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:06.374166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:06.374653 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:06.375536 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:06.375864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:06.551247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:06.562501 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-86a05f56-6e8c-42e6-9c09-043ec4d42f09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.200759 Jul 25 19:06:06.563196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 130/263] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:06 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:06.586679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:06.587316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:06.598096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:06.598606 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:06.599407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:06.600246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:06.772105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:06.781075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-28075b9b-9b0f-4c93-ac53-2a0db53dc2e9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.199569 Jul 25 19:06:06.781649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 134/264] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:06 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:07.587070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:07.587686 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:07.594927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:07.595585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:07.596413 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:07.596955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:07.757413 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:07.768100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9b3d346c-d7b8-49e4-806c-45dc2b377da5 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.184710 Jul 25 19:06:07.768634 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 131/265] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:07 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:07.808223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:07.808898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:07.817023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:07.817460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:07.818228 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:07.818714 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:07.970807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:07.974464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.985533 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-900de823-ecac-4b75-80ae-06b22b287715 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.180797 Jul 25 19:06:07.986475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 135/266] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:07 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:08.790072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:08.790894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:08.801834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:08.801834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:08.801834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:08.801834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:08.965687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:08.974017 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-326055b4-dccc-4b2f-882d-05ca609b7fed tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.187451 Jul 25 19:06:08.975070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 132/267] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:08 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:09.019150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:09.019991 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:09.028352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:09.028946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:09.030340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:09.030904 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:09.191045 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:09.199369 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-43083c84-b496-4af6-9116-f7c3a76ccb62 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.186163 Jul 25 19:06:09.199953 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 136/268] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:09 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:09.995635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:09.996276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:10.003377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:10.003831 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:10.004620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:10.005053 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:10.152478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:10.157786 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.163474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-216d0da4-7f1f-43fb-a613-ec606e0e8634 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.171381 Jul 25 19:06:10.163867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 133/269] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:09 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:10.221549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:10.222143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:10.228699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:10.229145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:10.229923 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:10.230393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:10.377470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:10.385940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ff3d9e65-ecd5-44b9-af43-4faa5f423e71 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.168172 Jul 25 19:06:10.386618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 137/270] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:10 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:11.189676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:11.190395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:11.198361 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:11.198850 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:11.199728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:11.200182 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:11.356757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:11.364432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-31c43325-6211-4d43-8b67-be105cd6d05d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.180437 Jul 25 19:06:11.365003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 134/271] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:11 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:11.408396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:11.409024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:11.415994 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:11.417159 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:11.417292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:11.417622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:11.568517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:11.576703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c4d58f0e-3d13-4480-ac61-249eb1960c91 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.172338 Jul 25 19:06:11.577320 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 138/272] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:11 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:12.386540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:12.387841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:12.395211 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:12.395655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:12.396485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:12.396904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:12.554491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:12.564481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-98b391c8-4025-4e87-86c4-14adfdf2501c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.182997 Jul 25 19:06:12.565057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 135/273] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:12 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:12.599585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:12.600191 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:12.606827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:12.607276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:12.608158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:12.608625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:12.747224 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:12.756098 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3f7bc80f-94f4-4469-ba70-dc57a4eca0ac tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.160666 Jul 25 19:06:12.756679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 139/274] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:12 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:13.604910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:13.605684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:13.616469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:13.617121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:13.618138 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:13.620045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:13.777925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:13.778179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:13.779492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:13.786737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:13.787188 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:13.788074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:13.788544 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:13.788835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-942458cf-6071-44d4-903d-8e907c46e860 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.188906 Jul 25 19:06:13.790199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 136/275] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:13 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:13.935232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:13.944857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b02dcec3-8a34-41ba-82b3-1d9ddfdc4662 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.170555 Jul 25 19:06:13.945562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 140/276] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:13 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:14.811719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:14.812319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:14.819490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:14.819940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:14.820739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:14.821175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:14.961107 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:14.969805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-628cf3d9-b4ea-4298-86cb-6a8f99b73e07 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.163002 Jul 25 19:06:14.970409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 137/277] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:14 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:14.971583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:14.972235 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:14.979245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:14.979683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:14.980451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:14.980882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:15.129074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:15.139928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b7f7869f-449f-446f-bd4b-5e8cb2093a37 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.173388 Jul 25 19:06:15.140743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 141/278] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:14 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:15.991667 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:15.992171 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:16.000055 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:16.000539 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:16.001415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:16.001833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:16.141438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:16.149543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e2608c91-7b20-4af3-a74c-36dfed2e1b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.161916 Jul 25 19:06:16.150122 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 138/279] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:15 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:16.176694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:16.177328 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:16.184308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:16.185505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:16.186479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:16.186875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:16.342120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:16.349612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-19e3e7b0-b573-403a-8d70-472b5efa61f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.176794 Jul 25 19:06:16.350179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 142/280] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:16 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:17.172812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:17.173436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:17.180494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:17.180935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:17.181713 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:17.182141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:17.326875 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:17.335028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5c1f4dc8-6509-4794-a3d4-f2cc9496bfe9 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.167318 Jul 25 19:06:17.335615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 139/281] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:17 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:17.372891 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:17.373852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:17.375813 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=68 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:17.381565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:17.382105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:17.383444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:17.394412 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:17.536171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:17.545877 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-db0ba5d6-5857-4a4d-8abd-c422a04efcc2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.177616 Jul 25 19:06:17.546477 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 143/282] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:17 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:18.359334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:18.360412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:18.371229 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:18.371949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:18.373032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:18.373493 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:18.519472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:18.527717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c9c945cb-d068-42d8-b7c5-9525ab804642 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.174562 Jul 25 19:06:18.528332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 140/283] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:18 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:18.578383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:18.579102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:18.586356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:18.586828 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:18.587641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:18.588076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:18.744422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:18.752146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-599e1bdd-9751-470c-babf-9d8478e3e9e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.178659 Jul 25 19:06:18.752725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 144/284] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:18 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:19.554463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:19.555075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:19.562548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:19.562994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:19.563776 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:19.564210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:19.721632 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:19.733634 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2072edf0-48a1-4d02-8aff-ba09823a8630 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.182788 Jul 25 19:06:19.734589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 141/285] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:19 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:19.777007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:19.777674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:19.785958 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:19.786509 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:19.787289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:19.787731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:19.938750 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:19.949835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4de22c0d-76c3-4b9d-b669-fcd1f83874ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.177250 Jul 25 19:06:19.951226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 145/286] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:19 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:20.608843 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-29980237-0992-44ef-9aca-3ecaa087b17a req-0526e1ba-d49d-43b1-b2dc-6bbcff80dcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a38f0-cdb6-410e-848f-de5a389cb502", "name": "network-vif-plugged", "status": "completed", "tag": "04e8bc93-ceba-4008-899e-d3dc6112d7e7"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:20.629005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-29980237-0992-44ef-9aca-3ecaa087b17a req-0526e1ba-d49d-43b1-b2dc-6bbcff80dcac service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:20.629769 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-29980237-0992-44ef-9aca-3ecaa087b17a req-0526e1ba-d49d-43b1-b2dc-6bbcff80dcac service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:20.759975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:20.761003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:20.770421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:20.771137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:20.772175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:20.772837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:20.854428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-29980237-0992-44ef-9aca-3ecaa087b17a req-0526e1ba-d49d-43b1-b2dc-6bbcff80dcac service nova] Creating event network-vif-plugged:04e8bc93-ceba-4008-899e-d3dc6112d7e7 for instance 533a38f0-cdb6-410e-848f-de5a389cb502 on hv-cinder-82002 Jul 25 19:06:20.874503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-29980237-0992-44ef-9aca-3ecaa087b17a req-0526e1ba-d49d-43b1-b2dc-6bbcff80dcac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263781 Jul 25 19:06:20.874503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 142/287] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:20.961232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:20.971968 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ab83983b-9278-421a-a916-2cdb35f6d9f2 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.216603 Jul 25 19:06:20.984433 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 146/288] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:20 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:20.984595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:20.984595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:20.988503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:20.988503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:20.988503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:20.988503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:21.154205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:21.166341 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3d711fca-14ea-4bc4-91b2-ad44160aba4a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.195776 Jul 25 19:06:21.166940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 143/289] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:20 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:21.996814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:21.998142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:22.004811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:22.005157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:22.005932 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:22.006394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:22.190637 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:22.191327 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:22.208862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:22.211579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:22.212768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:22.213210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:22.302541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:22.311660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6b1f465f-a765-4e17-92df-b8535cc069bc tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.318964 Jul 25 19:06:22.312355 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 147/290] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:21 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:22.392480 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:22.400470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-71cfd08d-edde-45ac-92c7-4542cd6adf8a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.214704 Jul 25 19:06:22.401043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 144/291] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:22 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:23.333752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:23.334386 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:23.340765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.341213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.342137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.342595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.394426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:23.395066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:23.401623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.402355 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.403310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.403750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.431762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:06:23.488771 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:23.496279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d6627e14-2287-4e1a-84a9-79318c83a773 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.167077 Jul 25 19:06:23.496847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 148/292] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:23 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:23.502135 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:23.502773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:23.509041 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.509553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.510356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.510792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.713338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bfdefa39-fde4-425b-8c30-c25f11930c01 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 204 len: 0 microversion: 2.1 time: 0.322937 Jul 25 19:06:23.714231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 145/293] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:06:23 2022] DELETE /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:23.721310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:23.723939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:23.724953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:23.731211 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.732022 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.733238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:23.734489 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:23.735122 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4eb094f9-5146-4b3d-b586-1cb2476c8429 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.235903 Jul 25 19:06:23.750572 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 149/294] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:23 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:23.978008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:23.991927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2bca6ca1-6f84-4b99-af12-ad6ad9dd1caa tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.273366 Jul 25 19:06:23.993472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 146/295] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:23 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:24.519843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:24.520541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:24.526740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:24.527177 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:24.527936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:24.528365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:24.692407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:24.701462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-492a61c0-6411-42ac-a34e-f73e1aee080c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1314 microversion: 2.1 time: 0.186697 Jul 25 19:06:24.702044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 150/296] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:24 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:24.759651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:24.760858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:24.772551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:24.773387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:24.774750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:24.775574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:24.939297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:24.947415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8bc90e8c-6a36-43c6-8775-6616badfb553 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.194033 Jul 25 19:06:24.948655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 147/297] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:24 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:25.015469 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:25.016102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:25.022463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:25.022997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:25.023890 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:25.024484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:25.173487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:25.182970 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-54b5565d-11b7-48a5-b8ce-8d8363ba9d82 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.172144 Jul 25 19:06:25.196447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 151/298] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:25 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:25.722817 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:25.723469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:25.741802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:25.742194 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:25.743077 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:25.744614 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:25.903985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:25.913100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1fef58c0-2170-437f-afb2-3a0047595eb0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1498 microversion: 2.1 time: 0.194226 Jul 25 19:06:25.914175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 148/299] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:25 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:25.970312 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:25.979716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:25.979716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:25.979716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:25.980522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:25.988808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:26.005627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.146050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:26.154362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-663d33cf-c2b6-4d17-9d6b-ce28e3ee9794 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.189066 Jul 25 19:06:26.155168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 152/300] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:25 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:26.205220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:26.205869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:26.212403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:26.213044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:26.213881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:26.214319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:26.236755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.360934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:26.369770 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4f65dd1a-5f83-4149-b357-479162605957 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.168458 Jul 25 19:06:26.371333 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 149/301] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:26 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:27.177483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:27.178087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:27.184232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:27.184620 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:27.185387 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:27.185817 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:27.324210 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:27.332560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5a92e7be-63e0-4cf5-b1a8-c64ed96f339a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.159309 Jul 25 19:06:27.333132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 153/302] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:27 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:27.391450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:27.392052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:27.399315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:27.399655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:27.400437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:27.400888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:27.565834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:27.574078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f525742f-e9eb-4ebb-bd09-89d745a5b37a tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.186678 Jul 25 19:06:27.574971 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 150/303] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:27 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:28.354663 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:28.355267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:28.361512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:28.361952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:28.362921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:28.363300 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:28.502251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:28.510402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9fb920ef-b82a-46ac-a9a2-1a6cbba895f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.159702 Jul 25 19:06:28.510984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 154/304] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:28 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:28.596170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:28.596751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:28.604492 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:28.604937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:28.605713 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:28.606165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:28.783478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:28.791706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ad45baf2-7803-45cc-a6cb-15ab833824d0 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.199625 Jul 25 19:06:28.792287 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 151/305] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:28 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:29.535122 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:29.535773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:29.543933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:29.544502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:29.545307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:29.545743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:29.683841 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:29.691561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3bdc7c84-01e7-4163-91b2-9a5af30c2679 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.161212 Jul 25 19:06:29.692134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 155/306] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:29 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:29.814740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:29.815445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:29.822172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:29.822662 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:29.823538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:29.823984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:29.971868 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:29.981548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1518cd1f-7edd-4e43-8344-4be51789d756 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.171676 Jul 25 19:06:29.982507 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 152/307] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:29 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:30.713378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:30.714646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:30.721577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:30.722026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:30.722840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:30.723268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:30.873678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:30.882232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7c1fd476-5ec8-4068-a6dc-909feeacad82 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.172617 Jul 25 19:06:30.883143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 156/308] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:30 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:31.003665 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:31.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:31.011458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:31.012627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:31.013478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:31.014003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:31.184992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:31.193999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-847f702b-1ba3-4f52-bc88-791ae41b3d64 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.194423 Jul 25 19:06:31.194931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 153/309] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:30 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:31.904914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:31.906516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:31.913199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:31.913642 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:31.914449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:31.914884 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.059707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:32.067779 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1e6a14fe-0504-4932-8b6f-040421be5e54 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.166856 Jul 25 19:06:32.070380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 157/310] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:31 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:32.215812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:32.216432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:32.219394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.224683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:32.225139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.225927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:32.226389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.333873 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:32.334665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:32.341982 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:32.342455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.343823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:32.344457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.371287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:06:32.373559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:32.382867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2666c1fa-fe51-48cd-bd75-d7f2463485fb tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.170752 Jul 25 19:06:32.383451 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 154/311] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:32 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:32.759794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-aab4ee82-df9e-4276-8e3a-b7c02656b87b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "DELETE /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 204 len: 0 microversion: 2.1 time: 0.430449 Jul 25 19:06:32.760651 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 158/312] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:06:32 2022] DELETE /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:32.770726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:32.771752 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:32.778978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:32.779625 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.781094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:32.781926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:32.930122 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:32.938865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cfc573e1-28c2-47ff-9baa-419bc72f661a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1504 microversion: 2.1 time: 0.172063 Jul 25 19:06:32.939447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 155/313] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:32 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:33.090677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:33.091363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:33.099295 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:33.099770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:33.100618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:33.100962 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:33.263898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:33.269669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ae98da91-cc2f-4c13-b9ba-6c562186fd23 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.183421 Jul 25 19:06:33.270252 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 159/314] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:33 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:33.405984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:33.406960 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:33.414994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:33.415271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:33.416058 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:33.416499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:33.568234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:33.576509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a2d45168-d61b-49ff-aaef-735af2fa855b tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.174994 Jul 25 19:06:33.577075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 156/315] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:33 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:33.961470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:33.961470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:33.975739 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:33.976331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:33.977585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:33.978075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:34.121465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:34.130131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-89468871-3826-430e-a2a4-934f3b40055d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1504 microversion: 2.1 time: 0.174342 Jul 25 19:06:34.130745 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 160/316] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:33 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:34.291629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:34.292359 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:34.299750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:34.301826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:34.301826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:34.301826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:34.449608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:34.457568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0f7537f9-696b-45c7-adc1-b3632ade6ef2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.169766 Jul 25 19:06:34.458216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 157/317] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:34 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:34.598360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:34.598964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:34.606255 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:34.606773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:34.607545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:34.607974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:34.778511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:34.788058 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-14080091-0961-43f8-aeca-41bf1b34a457 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.193642 Jul 25 19:06:34.788634 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 161/318] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:34 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:35.152463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:35.153087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:35.161669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:35.161669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:35.162415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:35.162860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:35.396400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:35.421660 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ef94cfc1-dfc4-4fd8-80f9-282b457305ce tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1504 microversion: 2.1 time: 0.272910 Jul 25 19:06:35.422418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 158/319] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:35 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:35.480644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:35.481257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:35.490412 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:35.492236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:35.494386 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:35.494862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:35.741450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:35.749093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-35f238b6-8197-478a-aade-5478e624e2ea tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.272443 Jul 25 19:06:35.758406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 162/320] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:35 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:35.814820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:35.816852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:35.828289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:35.828944 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:35.833206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:35.833206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:36.019431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:36.027702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4057333a-8312-4d03-8ac8-3339e05587dc tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1553 microversion: 2.1 time: 0.219229 Jul 25 19:06:36.028813 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 159/321] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:35 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:36.258914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-a3b38377-3e31-4402-ac85-8d0201da4ed2 req-24a62677-8a47-47df-ba9e-345910db4667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3ed71b-85b5-454f-a874-b0f7031ef007", "name": "network-vif-deleted", "tag": "c4d00d96-da69-4fe8-988f-496608d9e3c9"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:36.270482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-a3b38377-3e31-4402-ac85-8d0201da4ed2 req-24a62677-8a47-47df-ba9e-345910db4667 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:36.270925 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-a3b38377-3e31-4402-ac85-8d0201da4ed2 req-24a62677-8a47-47df-ba9e-345910db4667 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:36.283757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-a3b38377-3e31-4402-ac85-8d0201da4ed2 req-24a62677-8a47-47df-ba9e-345910db4667 service nova] Creating event network-vif-deleted:c4d00d96-da69-4fe8-988f-496608d9e3c9 for instance fd3ed71b-85b5-454f-a874-b0f7031ef007 on hv-cinder-82002 Jul 25 19:06:36.289882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-a3b38377-3e31-4402-ac85-8d0201da4ed2 req-24a62677-8a47-47df-ba9e-345910db4667 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034917 Jul 25 19:06:36.290836 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 163/322] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:36.450217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:36.450881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:36.457289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:36.458210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:36.459089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:36.459520 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:36.613593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:36.621924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4c2549c5-2ebb-41eb-a03c-6896142f2595 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1504 microversion: 2.1 time: 0.175631 Jul 25 19:06:36.622568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 160/323] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:36 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:36.771635 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:36.772463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:36.781151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:36.781811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:36.782740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:36.783339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:37.053664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:37.053664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:37.059904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:37.060444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:37.061404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:37.061910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:37.132253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:37.143291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9ff034e7-5ebc-4b59-99f9-076ce8d51d11 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1346 microversion: 2.1 time: 0.096005 Jul 25 19:06:37.144423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 161/324] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:37 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:37.216703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:37.234307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9d41ff7d-91bb-4091-b2da-a7283f0685ff tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1523 microversion: 2.1 time: 0.466135 Jul 25 19:06:37.235751 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 164/325] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:36 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:37.649780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:37.650739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:37.658534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:37.659343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:37.660561 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:37.661210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:37.915827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:37.929832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d34c7c81-49e5-4009-ada9-c12d2bffef06 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1504 microversion: 2.1 time: 0.284762 Jul 25 19:06:37.931278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 162/326] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:37 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:38.166651 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:38.168249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:38.175334 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.176100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.177536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.177978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.212948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.213391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.216061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lazy-loading 'fault' on Instance uuid fd3ed71b-85b5-454f-a874-b0f7031ef007 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:06:38.259803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:38.260460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:38.266618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0464996da4f44008ca8b91c837ac22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463f573db9d84c03900d443e4f6585cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:38.270749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.273524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.273524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.273524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.275588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d9ff0cce-9f42-4e37-81d6-e048eb19f804 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 200 len: 1351 microversion: 2.1 time: 0.113936 Jul 25 19:06:38.276550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 165/327] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:38 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:38.307625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-0f03c92f-df3a-4931-878c-ac433e6d9d2d req-13b68034-bf9d-4cf5-a519-cf5bbe5f0b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a38f0-cdb6-410e-848f-de5a389cb502", "name": "network-vif-deleted", "tag": "04e8bc93-ceba-4008-899e-d3dc6112d7e7"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:38.318406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-0f03c92f-df3a-4931-878c-ac433e6d9d2d req-13b68034-bf9d-4cf5-a519-cf5bbe5f0b7d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.318853 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-0f03c92f-df3a-4931-878c-ac433e6d9d2d req-13b68034-bf9d-4cf5-a519-cf5bbe5f0b7d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.330596 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-0f03c92f-df3a-4931-878c-ac433e6d9d2d req-13b68034-bf9d-4cf5-a519-cf5bbe5f0b7d service nova] Creating event network-vif-deleted:04e8bc93-ceba-4008-899e-d3dc6112d7e7 for instance 533a38f0-cdb6-410e-848f-de5a389cb502 on hv-cinder-82002 Jul 25 19:06:38.336730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-0f03c92f-df3a-4931-878c-ac433e6d9d2d req-13b68034-bf9d-4cf5-a519-cf5bbe5f0b7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Jul 25 19:06:38.339068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 166/328] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:38.464899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:38.478272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c63fcc92-4c6f-4868-b660-af18a857782d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1503 microversion: 2.1 time: 0.222212 Jul 25 19:06:38.484639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 163/329] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:38 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:38.504897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:38.507950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:38.513374 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.514243 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.515252 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.515938 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.682179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:38.691837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2233650a-c715-4946-b252-a98baafbf22e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1515 microversion: 2.1 time: 0.193280 Jul 25 19:06:38.693040 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 167/330] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:38 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:38.959812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:38.960633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:38.967011 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.967521 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:38.968582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:38.969086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:39.004288 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:39.004733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:39.005180 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lazy-loading 'fault' on Instance uuid 533a38f0-cdb6-410e-848f-de5a389cb502 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:06:39.051251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:39.059137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e59df410-b15d-4b48-9ab7-3284e6f94510 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 200 len: 1304 microversion: 2.1 time: 0.109295 Jul 25 19:06:39.059694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 164/331] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:38 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:39.303805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:39.304486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:39.310973 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:39.317682 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:39.317682 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:39.317682 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:39.330098 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] HTTP exception thrown: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Request method failure captured: Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 HTTP/1.1 Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk_CRfRkB75V2eb32FnhRQThteZJ_Fzf-ImNHXY0E2cNfDM65qRZ3hL0ARok6OszUJsU6wpBrOR0XNveZ8LO7cktkZ06wIB5VFAzVg8QjpdikVG1tns7cDWns2TgIKEhrBWGPqeRrWPlkG3e2w7BysNw-OPdSJAGtnNT15ta0zcR8A Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:06:39.334875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_463f573db9d84c03900d443e4f6585cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: c0464996da4f44008ca8b91c837ac22d Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.336819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'fd3ed71b-85b5-454f-a874-b0f7031ef007'} Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:06:39.339137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.341599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.343493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Returning 404 to user: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:06:39.343493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e4b346dc-77fb-4442-aa77-35a0c1be1961 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 404 len: 111 microversion: 2.1 time: 0.037220 Jul 25 19:06:39.343493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 168/332] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:39 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:06:39.518075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:39.520525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:39.529495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:39.530765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:39.531900 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:39.532364 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:39.547133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] HTTP exception thrown: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Request method failure captured: Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007/os-volume_attachments HTTP/1.1 Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk_CRfRkB75V2eb32FnhRQThteZJ_Fzf-ImNHXY0E2cNfDM65qRZ3hL0ARok6OszUJsU6wpBrOR0XNveZ8LO7cktkZ06wIB5VFAzVg8QjpdikVG1tns7cDWns2TgIKEhrBWGPqeRrWPlkG3e2w7BysNw-OPdSJAGtnNT15ta0zcR8A Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:06:39.551259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_463f573db9d84c03900d443e4f6585cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: c0464996da4f44008ca8b91c837ac22d Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.552471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'server_id': 'fd3ed71b-85b5-454f-a874-b0f7031ef007'} Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:06:39.553129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:39.554254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:39.556967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Returning 404 to user: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:06:39.558029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7d97afa7-a8a1-4c14-8635-a6f78a5b7114 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044716 Jul 25 19:06:39.563531 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 165/333] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:06:39 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:06:40.086676 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:40.087708 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 533a38f0-cdb6-410e-848f-de5a389cb502] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:40.095606 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:40.096067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:40.096888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:40.097512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:40.102130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.262250 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] HTTP exception thrown: Instance 533a38f0-cdb6-410e-848f-de5a389cb502 could not be found. Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Request method failure captured: Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 HTTP/1.1 Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3umCFXwOx8_SHZOhXfGWcviJ3353vFVHK3ABBh7bFni69PDxMK-JFkIFFrRJFxDZrH_HTadwx5aBx0GK2RgMUdv1sQvPU0VFz5PxhM8pK3Cd35PJk6TqjRDaZ-wA1E7Tofd-4hvMWUYQHjNBs8MyjrEaELpLNflOvikH0pydTLMsxxA Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 9062c0ee33bb464c88d5f5e7471c6961 Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesActionsTest-3854712 Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:06:40.263831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9062c0ee33bb464c88d5f5e7471c6961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9062c0ee33bb464c88d5f5e7471c6961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9062c0ee33bb464c88d5f5e7471c6961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9062c0ee33bb464c88d5f5e7471c6961", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesActionsTest-3854712 Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 9062c0ee33bb464c88d5f5e7471c6961 Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesActionsTest-3854712 Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesActionsTest-3854712-project Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 8d04f1378edc435a801a6c2719ec31f5 Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesActionsTest-3854712-project Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 533a38f0-cdb6-410e-848f-de5a389cb502 could not be found. Jul 25 19:06:40.265731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '533a38f0-cdb6-410e-848f-de5a389cb502'} Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533a38f0-cdb6-410e-848f-de5a389cb502 could not be found. Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:06:40.269690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533a38f0-cdb6-410e-848f-de5a389cb502 could not be found. Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533a38f0-cdb6-410e-848f-de5a389cb502 could not be found. Jul 25 19:06:40.271347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:06:40.272564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Returning 404 to user: Instance 533a38f0-cdb6-410e-848f-de5a389cb502 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:06:40.272564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6525bf0b-02d2-4eca-a2ff-d891bd038889 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502" status: 404 len: 111 microversion: 2.1 time: 0.183772 Jul 25 19:06:40.272564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 169/334] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:40 2022] GET /compute/v2.1/servers/533a38f0-cdb6-410e-848f-de5a389cb502 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:06:40.459186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2119944758", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "networks": [{"uuid": "dbccd2f8-6687-4a50-9cd2-a6a34be80480"}]}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:40.542927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] validate_networks() for [('dbccd2f8-6687-4a50-9cd2-a6a34be80480', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:06:40.934893 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:06:40.935712 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:06:40.936423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:06:40.937531 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:06:40.938422 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:06:40.955297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:40.955297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:40.955297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:40.955297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:40.973534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Getting quotas for project 9062c0ee33bb464c88d5f5e7471c6961. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:06:40.977690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Getting quotas for user 8d04f1378edc435a801a6c2719ec31f5 and project 9062c0ee33bb464c88d5f5e7471c6961. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:06:40.997815 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:06:41.000347 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:06:41.180771 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-be68a9cd-6936-4462-90ba-8bcd297fa620 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727252 Jul 25 19:06:41.182116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 166/335] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:06:41.199016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-675ddf21-f304-4d5f-926b-9c79139ca786 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:41.201270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-675ddf21-f304-4d5f-926b-9c79139ca786 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:41.268611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-675ddf21-f304-4d5f-926b-9c79139ca786 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:41.277690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-675ddf21-f304-4d5f-926b-9c79139ca786 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1214 microversion: 2.1 time: 0.088579 Jul 25 19:06:41.278444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 170/336] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:41 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:41.682279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:41.684720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:41.694515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:41.694515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:41.694515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:41.694515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:41.698254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.720002 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'flavor' on Instance uuid bffab6ed-1699-49d7-bee1-73e045f1e868 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:06:42.031287 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6648e48a-abc8-4d42-9449-3fddcc47e352 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/action" status: 200 len: 32 microversion: 2.1 time: 0.354071 Jul 25 19:06:42.032120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 167/337] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:06:41 2022] POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:06:42.042661 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:42.043781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:42.050708 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.051152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.053249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.053249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.087333 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:42.088011 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:42.110085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.110582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.111387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.113303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.131950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] HTTP exception thrown: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Request method failure captured: Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 HTTP/1.1 Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk_CRfRkB75V2eb32FnhRQThteZJ_Fzf-ImNHXY0E2cNfDM65qRZ3hL0ARok6OszUJsU6wpBrOR0XNveZ8LO7cktkZ06wIB5VFAzVg8QjpdikVG1tns7cDWns2TgIKEhrBWGPqeRrWPlkG3e2w7BysNw-OPdSJAGtnNT15ta0zcR8A Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:06:42.134871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_463f573db9d84c03900d443e4f6585cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: c0464996da4f44008ca8b91c837ac22d Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.136188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'fd3ed71b-85b5-454f-a874-b0f7031ef007'} Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:06:42.136851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.137949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.139056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Returning 404 to user: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:06:42.139056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-47740ef0-41e1-46bb-9eb1-493104952c7f tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 404 len: 111 microversion: 2.1 time: 0.054646 Jul 25 19:06:42.139056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 168/338] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:06:42 2022] DELETE /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:06:42.146384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:42.147150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] [instance: fd3ed71b-85b5-454f-a874-b0f7031ef007] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:42.158408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.159155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.160204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.161246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.180916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] HTTP exception thrown: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Request method failure captured: Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 HTTP/1.1 Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk_CRfRkB75V2eb32FnhRQThteZJ_Fzf-ImNHXY0E2cNfDM65qRZ3hL0ARok6OszUJsU6wpBrOR0XNveZ8LO7cktkZ06wIB5VFAzVg8QjpdikVG1tns7cDWns2TgIKEhrBWGPqeRrWPlkG3e2w7BysNw-OPdSJAGtnNT15ta0zcR8A Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:06:42.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/463f573db9d84c03900d443e4f6585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_463f573db9d84c03900d443e4f6585cd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 463f573db9d84c03900d443e4f6585cd Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-DeleteServersTestJSON-872631984 Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: c0464996da4f44008ca8b91c837ac22d Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-DeleteServersTestJSON-872631984-project Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.183799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'fd3ed71b-85b5-454f-a874-b0f7031ef007'} Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:06:42.184457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. Jul 25 19:06:42.185860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:06:42.187649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] Returning 404 to user: Instance fd3ed71b-85b5-454f-a874-b0f7031ef007 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:06:42.187649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0dfa91b9-75e1-441f-9e44-b01e0f2db7a1 tempest-DeleteServersTestJSON-872631984 tempest-DeleteServersTestJSON-872631984-project] 10.222.0.17 "GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007" status: 404 len: 111 microversion: 2.1 time: 0.041824 Jul 25 19:06:42.187649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 169/339] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:42 2022] GET /compute/v2.1/servers/fd3ed71b-85b5-454f-a874-b0f7031ef007 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:06:42.258587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:42.271325 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8893b2ef-0754-4981-93a9-69b0fe865186 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.232836 Jul 25 19:06:42.288761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 171/340] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:42 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:42.305289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:42.305943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:42.313714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.314435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.315458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:42.316059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:42.414219 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:42.423648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1ee25061-7862-4d2c-9367-da38e16d1ecf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1218 microversion: 2.1 time: 0.122153 Jul 25 19:06:42.425094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 170/341] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:42 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:43.294650 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:43.296704 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:43.304607 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:43.305330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:43.306305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:43.306939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:43.447666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:43.449193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:43.460723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:43.461509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:43.464335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:43.464335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:43.566127 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:43.576680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7a6f495a-ec9e-48f8-813b-4fb34e39ba76 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.285820 Jul 25 19:06:43.585258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 172/342] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:43 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:43.588195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:43.623080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-92f306d3-dcfa-4faf-8c67-f08f25754d94 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1274 microversion: 2.1 time: 0.179757 Jul 25 19:06:43.624625 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 171/343] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:43 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:44.609472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:44.610472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:44.618588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:44.619309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:44.620561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:44.621222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:44.658631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:44.660347 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:44.676310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:44.679887 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:44.687409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:44.687409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:45.009047 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:45.026066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:45.026963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-179d01d9-9196-4f79-ab29-bcf9530bdada tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.373044 Jul 25 19:06:45.027767 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 172/344] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:44 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:45.042049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-26a96e70-9ff4-4ad8-8761-64f9b1428481 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.436891 Jul 25 19:06:45.042262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 173/345] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:44 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:45.981353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1879493470", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "networks": [{"uuid": "6a578d58-7b25-445c-860f-38e792f6130d"}]}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:46.043381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] validate_networks() for [('6a578d58-7b25-445c-860f-38e792f6130d', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:06:46.082218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:46.084363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:46.092142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:46.093920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:46.095657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:46.096574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:46.580186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:06:46.580793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:06:46.581420 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:06:46.581975 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:06:46.582568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:06:46.594187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:46.594954 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:46.595989 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:46.596618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:46.616947 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Getting quotas for project 387ac04100224395a581aa382deb19b0. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:06:46.624207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Getting quotas for user 5321524c39c14135b5cc77e21598cbe1 and project 387ac04100224395a581aa382deb19b0. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:06:46.630584 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:46.640591 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:06:46.640805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-81035700-1414-49ea-8977-5cce8b36b390 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.569653 Jul 25 19:06:46.653918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 174/346] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:46 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:46.653918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:46.653918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:46.654829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:46.655846 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:46.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:46.657049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:46.658817 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:06:46.791734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-20a0f011-692c-4a68-a885-3abbecca05e6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814439 Jul 25 19:06:46.793557 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 173/347] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:06:46.810162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7ae7bbec-e993-434c-8704-a8c2bf5ed4a6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:46.811425 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7ae7bbec-e993-434c-8704-a8c2bf5ed4a6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:46.941835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7ae7bbec-e993-434c-8704-a8c2bf5ed4a6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:46.955251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7ae7bbec-e993-434c-8704-a8c2bf5ed4a6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1219 microversion: 2.1 time: 0.149595 Jul 25 19:06:46.955888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 174/348] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:46 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:47.021976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:47.032117 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-49e94c97-f7d4-4c8e-90aa-dd4d91a307ae tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.389337 Jul 25 19:06:47.033234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 175/349] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:46 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:47.375224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-79d62c11-2197-429b-bfb5-f28e556a999a req-b10ae8cd-6819-4670-9c32-717bc7fdad25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb463f9-92ba-4071-9aa5-a1bdccc80710", "tag": "9dde897b-8e86-4be3-af08-f8cc6a7ba614"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:47.387169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-79d62c11-2197-429b-bfb5-f28e556a999a req-b10ae8cd-6819-4670-9c32-717bc7fdad25 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:47.387963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-79d62c11-2197-429b-bfb5-f28e556a999a req-b10ae8cd-6819-4670-9c32-717bc7fdad25 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:47.411470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-79d62c11-2197-429b-bfb5-f28e556a999a req-b10ae8cd-6819-4670-9c32-717bc7fdad25 service nova] Creating event network-changed:9dde897b-8e86-4be3-af08-f8cc6a7ba614 for instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 on hv-cinder-82002 Jul 25 19:06:47.422305 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-79d62c11-2197-429b-bfb5-f28e556a999a req-b10ae8cd-6819-4670-9c32-717bc7fdad25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052059 Jul 25 19:06:47.424045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 175/350] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:47.662695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:47.663337 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:47.667147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.679551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:47.681215 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:47.682557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:47.683067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:48.000023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-54829ec0-5eb4-46f0-94ce-2cc9c74c417b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:48.000857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-54829ec0-5eb4-46f0-94ce-2cc9c74c417b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:48.076172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:48.090701 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-aeef5ed4-86a6-4d35-918a-de7ee86dda33 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.432878 Jul 25 19:06:48.093053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 176/351] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:47 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:48.105218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:48.106151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:48.115455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:48.116171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:48.117263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:48.117783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:48.176556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-54829ec0-5eb4-46f0-94ce-2cc9c74c417b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:48.197184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-54829ec0-5eb4-46f0-94ce-2cc9c74c417b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1219 microversion: 2.1 time: 0.220731 Jul 25 19:06:48.198248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 176/352] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:47 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:48.477119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:48.490442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0a06dc96-e920-4f36-94f2-3fd6519f2726 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.392827 Jul 25 19:06:48.491013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 177/353] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:48 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:49.119753 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:49.120455 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:49.129581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:49.130374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:49.131449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:49.132152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:49.238740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:49.240581 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:49.249418 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:49.249946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:49.252243 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:49.252923 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:49.350293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:49.359505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-48915492-79cf-44cf-994d-56b2143cac27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1215 microversion: 2.1 time: 0.127273 Jul 25 19:06:49.359881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 178/354] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:49 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:49.513934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:49.515648 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:49.522141 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:49.522610 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:49.523392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:49.523819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:49.558815 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:49.573938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-39f61598-b46d-4ba4-9b2a-a089bf265d18 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.458129 Jul 25 19:06:49.587759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 177/355] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:49 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:49.705778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:49.717234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-26340d45-e2a7-487f-bef3-72cde128c401 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.206770 Jul 25 19:06:49.718363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 179/356] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:49 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:50.380619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:50.381237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:50.388149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:50.388513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:50.390225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:50.391080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:50.463728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:50.472008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-53aa1e91-1024-4d74-bd33-897c0b0a2927 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1215 microversion: 2.1 time: 0.095458 Jul 25 19:06:50.472585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 178/357] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:50 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:50.598042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:50.598690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:50.605139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:50.605586 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:50.606423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:50.606863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:50.742004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:50.742872 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:50.753898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:50.754977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:50.759563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:50.759563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:50.778221 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:50.786778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-89ede388-2e29-43bc-a470-62642769fd35 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.193180 Jul 25 19:06:50.791827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 180/358] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:50 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:50.916794 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:50.925221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fd20e59a-402f-436b-a3df-fadd569a9689 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.189875 Jul 25 19:06:50.925799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 179/359] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:50 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:51.493078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:51.493815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:51.495700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.500731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:51.501170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:51.502465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:51.502465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:51.573854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:51.583051 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d60531e1-13d5-439d-9275-2aeec3360339 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1215 microversion: 2.1 time: 0.093746 Jul 25 19:06:51.594843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 181/360] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:51 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:51.820236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:51.820982 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:51.828800 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:51.829283 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:51.830061 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:51.830718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:51.976984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:51.986757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0a1b5bcb-4bf6-4236-86d2-91431f2735d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.170225 Jul 25 19:06:51.987859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 180/361] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:51 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:51.992275 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:51.992906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:52.000337 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:52.000615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:52.001387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:52.001819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:52.038156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8e08f7c4-9cfe-4b01-895b-4ba438db27d8 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Action: 'create', calling method: .version_select at 0x7fd8e66881f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-303725694"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:52.163293 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:52.173399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6b646d05-dd3d-4a5f-b3ca-ec37fdafad09 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.184426 Jul 25 19:06:52.173399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 181/362] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:51 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:52.664044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:52.664044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:52.664044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:52.664044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:52.664534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:52.664534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:52.679728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:52.687961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d4f5a977-89ae-4c85-8932-4f2624dabf9e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1215 microversion: 2.1 time: 0.084617 Jul 25 19:06:52.688517 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 182/363] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:52 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:53.011230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:53.011927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:53.018976 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:53.019403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:53.020076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:53.020508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:53.155887 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:53.163803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b7951fe9-246a-4636-a651-24343d47cbc4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.156648 Jul 25 19:06:53.164385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 183/364] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:53 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:53.195972 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:53.196569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:53.203362 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:53.203804 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:53.204565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:53.205074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:53.353754 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:53.363243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c8f8f830-d52c-40d3-a69a-26f5d9c29601 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.171161 Jul 25 19:06:53.364103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 184/365] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:53 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:53.440043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8e08f7c4-9cfe-4b01-895b-4ba438db27d8 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.535855 Jul 25 19:06:53.447446 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 182/366] 10.222.0.17 () {60 vars in 1155 bytes} [Mon Jul 25 19:06:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1544 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 25 19:06:53.452937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dc9a066f-582d-4235-9f12-b6de552c3f06 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2daf0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:53.659299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dc9a066f-582d-4235-9f12-b6de552c3f06 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.210861 Jul 25 19:06:53.659865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 185/367] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:06:53 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:06:53.710629 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:53.711153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:53.718868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:53.720262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:53.720262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:53.720554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:53.786723 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:53.794267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d369f71c-9309-4c06-977d-a865c75da89e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1215 microversion: 2.1 time: 0.087680 Jul 25 19:06:53.794862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 183/368] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:53 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:54.192125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:54.192798 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:54.199851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:54.200332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:54.201135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:54.201714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:54.345141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:54.354794 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-71575580-c25c-4250-bc76-312e68dedca7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.166915 Jul 25 19:06:54.355385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 186/369] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:54 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:54.384649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:54.385280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:54.392346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:54.392788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:54.393557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:54.393984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:54.556383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:54.565754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5423fde6-bd0c-4afc-9d78-223e8b78a902 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.185106 Jul 25 19:06:54.566467 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 184/370] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:54 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:54.674626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1a7f5972-5ff9-4d87-bec9-c7a2e7128bec tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e7a91c10>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:54.725622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1a7f5972-5ff9-4d87-bec9-c7a2e7128bec tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.055999 Jul 25 19:06:54.726276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 187/371] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:06:54 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:54.816855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:54.817450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:54.823540 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:54.827568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:54.827568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:54.827568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:54.900504 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:54.908943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e2108fd6-1892-4678-bacc-894ae5c83fbd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1271 microversion: 2.1 time: 0.095914 Jul 25 19:06:54.909666 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 185/372] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:54 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:55.376040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:55.376643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:55.383052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:55.383508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:55.384301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:55.384733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:55.405818 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.523251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:55.531904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-57ce47af-032d-4d4d-9221-cce22d8e6ee0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.159945 Jul 25 19:06:55.532378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 188/373] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:55 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:55.588732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:55.589351 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:55.595895 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:55.596465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:55.597131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:55.597566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:55.740723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0abe934f-891e-4986-9def-59225a167a63 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e6039ee0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:55.742303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:55.752285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-416b57e3-50f6-4159-9359-9a22f7f7f8e1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.167053 Jul 25 19:06:55.752594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 186/374] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:55 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:55.797318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0abe934f-891e-4986-9def-59225a167a63 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 345 microversion: 2.1 time: 0.061141 Jul 25 19:06:55.797884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 189/375] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:06:55 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:55.810362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7557f3b1-8636-4cb3-a78c-950f6f91834b tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Action: 'create', calling method: .version_select at 0x7fd8e666c430>, body: {"snapshot": {"volume_id": "90c75c15-d927-449b-b672-161850e5036b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-471032769"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:06:55.931529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:55.931921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:55.933774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.940306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:55.940306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:55.941012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:55.941457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:56.011797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:56.016016 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-33a9afd0-ad6c-4481-9915-92cbeb0a48f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.088689 Jul 25 19:06:56.016580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 190/376] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:55 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:56.318922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7557f3b1-8636-4cb3-a78c-950f6f91834b tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.512332 Jul 25 19:06:56.319665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 187/377] 10.222.0.17 () {60 vars in 1162 bytes} [Mon Jul 25 19:06:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:56.332816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-24b2443d-1168-4b7e-859e-e0a3b508ac93 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5edb790>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:56.362789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-24b2443d-1168-4b7e-859e-e0a3b508ac93 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.035746 Jul 25 19:06:56.363392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 191/378] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:06:56 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:56.374402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-135b9bff-1d9b-4d7b-b9ee-5de78cba81b5 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e6688040>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:56.407501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-135b9bff-1d9b-4d7b-b9ee-5de78cba81b5 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037122 Jul 25 19:06:56.408065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 188/379] 10.222.0.17 () {58 vars in 1140 bytes} [Mon Jul 25 19:06:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:56.419395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-92ff14f4-0083-43be-832e-380f05ec2b83 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d9ab80>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:56.449782 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-92ff14f4-0083-43be-832e-380f05ec2b83 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.034113 Jul 25 19:06:56.450373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 192/380] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:06:56 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:56.553272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:56.553799 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:56.560834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:56.561986 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:56.563016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:56.563465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:56.700905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:56.709209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-91465c08-ef68-49c4-b2ab-bf5a0b23bc4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.159920 Jul 25 19:06:56.709772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 189/381] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:56 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:56.770935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=4 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.775515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:56.776153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:56.784489 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:56.785609 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:56.786447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:56.786879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:56.940368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:56.948363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0b3ce5cb-7b4e-458b-b877-79ffd587192b tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.178170 Jul 25 19:06:56.948990 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 193/382] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:56 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:57.038309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:57.038940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:57.046130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:57.046611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:57.047492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:57.048193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:57.064160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.116402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:57.124314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-66f5337f-5a66-40f5-96d3-d25e8f0d560d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.089715 Jul 25 19:06:57.124664 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 190/383] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:57 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:57.462833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fda4ff9e-35b8-4f24-9651-113f0a02e9b0 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5fb9700>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:57.493150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fda4ff9e-35b8-4f24-9651-113f0a02e9b0 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.034149 Jul 25 19:06:57.493721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 194/384] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:06:57 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:57.731070 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:57.731605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:57.738411 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:57.738853 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:57.739613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:57.740037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:57.878096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:57.886867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8a73c7d5-9486-48fd-b21a-6a8925daa1a3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.159742 Jul 25 19:06:57.887429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 191/385] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:57 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:57.971302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:57.971919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:57.978377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:57.978836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:57.979619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:57.980055 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:58.119181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:58.127622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4ef40c5b-287c-4e8d-b87e-b13eaf156c22 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.160763 Jul 25 19:06:58.128363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 195/386] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:57 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:58.146202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:58.146847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:58.153236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:58.153686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:58.154579 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:58.156702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:58.223201 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:58.230761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ae38a136-c9f7-4dff-8be9-5ebd425b3f02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.088450 Jul 25 19:06:58.231328 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 192/387] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:58 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:58.505877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0fddc046-a1bc-47f7-8dd2-cc7e1d83ff08 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d23f70>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:58.512109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=16 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:58.538517 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0fddc046-a1bc-47f7-8dd2-cc7e1d83ff08 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.036519 Jul 25 19:06:58.539080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 196/388] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:06:58 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:06:58.908209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:58.908812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:58.915081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:58.915522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:58.916304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:58.916716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:59.062582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:59.071550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f2fe8407-45ef-4503-9b97-078d40c36ca6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.167413 Jul 25 19:06:59.072114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 193/389] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:58 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:59.149757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:59.150390 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:59.158308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:59.158827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:59.159617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:59.160057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:59.255021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:59.255636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:06:59.262304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:59.262776 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:59.263548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:06:59.263979 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:06:59.309449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:59.317362 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-81dae96f-f18a-4d2b-bd26-83af960b4a54 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.171936 Jul 25 19:06:59.317845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 197/390] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:59 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:59.331670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:06:59.339775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-099a9678-3f7c-43e9-8084-bb74c99af0ff tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.088955 Jul 25 19:06:59.340445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 194/391] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:06:59 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:59.551164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b44e9c21-72ac-489a-a0dc-dd42d41089bc tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5edb790>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:06:59.581133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b44e9c21-72ac-489a-a0dc-dd42d41089bc tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.033802 Jul 25 19:06:59.581695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 198/392] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:06:59 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:00.093131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:00.093768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:00.100624 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:00.101064 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:00.101833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:00.102262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:00.234760 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:00.242817 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-faa0eaa5-f96e-4341-8167-060c4521aeeb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.153504 Jul 25 19:07:00.243394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 195/393] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:00 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:00.340447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:00.341049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:00.347699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:00.348193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:00.348959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:00.349382 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:00.361500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:00.362108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:00.368613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:00.369057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:00.369863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:00.370740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:00.442683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:00.450776 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-697a6090-2496-41f1-8b8e-5c25814749b0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.093567 Jul 25 19:07:00.451451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 196/394] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:00 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:00.488209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:00.495837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4493a24f-4fcf-4ab2-86cb-c7df30b162e3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.159772 Jul 25 19:07:00.496391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 199/395] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:00 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:00.593930 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-89932819-aa89-4ca2-8322-2992221b778e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e66cb3a0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:00.626485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-89932819-aa89-4ca2-8322-2992221b778e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.036505 Jul 25 19:07:00.629568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 197/396] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:00 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:01.264785 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:01.265407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:01.276970 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:01.277747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:01.279047 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:01.279707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:01.442843 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:01.450803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ea390577-f14f-404a-8795-d471b0c8d507 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.189983 Jul 25 19:07:01.451371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 200/397] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:01 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:01.473160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:01.473767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:01.480104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:01.480613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:01.481392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:01.481855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:01.518551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:01.519277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:01.525624 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:01.526162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:01.527137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:01.527626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:01.565643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:01.574165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f3ca0470-3cd8-4e66-aa84-2b39dd7527e4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.104938 Jul 25 19:07:01.574888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 198/398] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:01 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:01.642059 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ae6d070d-e7fd-4516-bd12-8d957e314f07 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e66cbc10>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:01.674549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ae6d070d-e7fd-4516-bd12-8d957e314f07 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.037310 Jul 25 19:07:01.675125 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 199/399] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:01 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:01.684849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:01.695231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dd4f2358-8aa5-4f53-90af-f5eb4e771d83 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.181661 Jul 25 19:07:01.695817 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 201/400] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:01 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:02.474094 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:02.474797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:02.481424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:02.481875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:02.482683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:02.483121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:02.597075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:02.601957 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:02.605666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:02.606195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:02.607066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:02.607571 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:02.621643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:02.629904 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c6567e0d-b367-467c-a485-7374b035cd88 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.160026 Jul 25 19:07:02.630512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 200/401] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:02 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:02.672357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:02.680246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c17b46b5-ce32-4027-a054-cd7b2306eb6d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.088143 Jul 25 19:07:02.680827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 202/402] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:02 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:02.687150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b022e89c-73e6-427a-889a-a13e96a08580 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e6760670>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:02.716811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:02.716811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:02.722073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b022e89c-73e6-427a-889a-a13e96a08580 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.038650 Jul 25 19:07:02.722890 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 201/403] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:02 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:02.723354 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:02.723807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:02.724598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:02.725038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:02.867622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:02.876833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8e2de106-0814-4e4c-87fc-36d7362c77df tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.164466 Jul 25 19:07:02.877423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 203/404] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:02 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:03.651549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:03.652232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:03.659054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:03.659054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:03.659811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:03.660377 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:03.701046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:03.701700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:03.709442 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:03.709883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:03.710687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:03.711124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:03.775697 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:03.784668 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-408f4d01-94ac-40d0-addc-604334ef71c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.086974 Jul 25 19:07:03.784998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 204/405] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:03 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:03.789592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-08a7e563-9ec2-4ec5-a1df-69ae58a26d9d tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2b3a0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:03.804022 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:03.814492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b193be67-411d-4f25-b288-fce9fdbbd0f8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.165486 Jul 25 19:07:03.814492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 202/406] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:03 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:03.826404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-08a7e563-9ec2-4ec5-a1df-69ae58a26d9d tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.040160 Jul 25 19:07:03.827371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 205/407] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:03 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:03.898173 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:03.898793 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:03.904862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:03.905303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:03.906086 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:03.907257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:04.041089 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:04.049179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-233ccbb9-c031-429b-ba5c-f5ff32bf06e8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.155064 Jul 25 19:07:04.049844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 203/408] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:03 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:04.808045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:04.808656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:04.815088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:04.815542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:04.816315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:04.816752 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:04.835324 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:04.835972 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:04.842412 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:04.842858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:04.846544 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:04.846544 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:04.883089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:04.892046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f975842e-a742-47b0-9ccc-1ce475bb1c21 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.088369 Jul 25 19:07:04.892655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 206/409] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:04 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:04.897411 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-32923ac6-7176-4d22-95dd-01413e4f3952 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2bf70>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:04.931378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-32923ac6-7176-4d22-95dd-01413e4f3952 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.037678 Jul 25 19:07:04.931942 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 207/410] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:04 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:04.982105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:04.992796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-df801fad-72ed-4d46-a063-31dc7cf27404 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.160445 Jul 25 19:07:04.993283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 204/411] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:04 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:05.069910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:05.070709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:05.077430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:05.078099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:05.080116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:05.080553 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:05.230654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:05.238349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5ccfe959-953f-4aad-9c13-40c453569ef8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.172496 Jul 25 19:07:05.239128 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 208/412] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:05 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:05.913411 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:05.914006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:05.920587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:05.921036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:05.921972 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:05.922587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:05.945003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b275c86e-a800-4aeb-ae75-781a9a2b96bf tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2b280>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:05.980502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b275c86e-a800-4aeb-ae75-781a9a2b96bf tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.039264 Jul 25 19:07:05.981528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 209/413] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:05 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:05.997685 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:06.006246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5194bae9-f9a8-4753-b656-2f268ede5459 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.096660 Jul 25 19:07:06.007111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 205/414] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:05 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:06.028707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:06.029298 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:06.037020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:06.037460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:06.038243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:06.038699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:06.177774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:06.185574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0b617f74-2aab-4e13-86e6-baa41a8d406a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.161396 Jul 25 19:07:06.186144 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 210/415] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:06 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:06.262730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:06.263238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:06.269358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:06.269795 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:06.270574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:06.271000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:06.418381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:06.426814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ad154742-22af-4b9e-8fae-7ed992bf4eb1 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.167897 Jul 25 19:07:06.427395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 206/416] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:06 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:06.573371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-00fe35a4-fee4-4030-82af-d65f5d50141c req-e834687d-033d-4dfe-9cc6-c7614f8c2729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb463f9-92ba-4071-9aa5-a1bdccc80710", "name": "network-vif-plugged", "status": "completed", "tag": "9dde897b-8e86-4be3-af08-f8cc6a7ba614"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:06.584528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-00fe35a4-fee4-4030-82af-d65f5d50141c req-e834687d-033d-4dfe-9cc6-c7614f8c2729 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:06.584977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-00fe35a4-fee4-4030-82af-d65f5d50141c req-e834687d-033d-4dfe-9cc6-c7614f8c2729 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:06.602367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-00fe35a4-fee4-4030-82af-d65f5d50141c req-e834687d-033d-4dfe-9cc6-c7614f8c2729 service nova] Creating event network-vif-plugged:9dde897b-8e86-4be3-af08-f8cc6a7ba614 for instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 on hv-cinder-82002 Jul 25 19:07:06.607786 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-00fe35a4-fee4-4030-82af-d65f5d50141c req-e834687d-033d-4dfe-9cc6-c7614f8c2729 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038611 Jul 25 19:07:06.608407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 211/417] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:06.994172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1bc76606-d6d8-432c-9214-8a46cf597093 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e65abd30>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:07.029130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1bc76606-d6d8-432c-9214-8a46cf597093 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.038753 Jul 25 19:07:07.029732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 207/418] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:06 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:07.034546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:07.035172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:07.042020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:07.042499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:07.043271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:07.043694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:07.108861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:07.117162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-12ac132b-7c36-4c40-b461-1aaa520f011a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.088816 Jul 25 19:07:07.117726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 212/419] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:07 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:07.207556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:07.208161 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:07.214834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:07.221774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:07.221774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:07.221774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:07.355066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:07.363976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7da3af5b-9f9e-4a2a-8d26-af6f908b1d8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.160277 Jul 25 19:07:07.366720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 208/420] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:07 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:07.448295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:07.448898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:07.455320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:07.455764 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:07.456543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:07.456969 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:07.603668 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:07.611612 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-75e7400f-79dd-4ba9-a2af-91153f108269 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.167183 Jul 25 19:07:07.612194 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 213/421] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:07 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:08.043227 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-52521fc2-e694-4e92-8296-d63e5b263fe9 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e682f430>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:08.090467 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-52521fc2-e694-4e92-8296-d63e5b263fe9 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 287 microversion: 2.1 time: 0.037063 Jul 25 19:07:08.090467 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 209/422] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:08 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:08.100811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dec5bf83-5f4f-4e33-9a88-8bfd48d0af87 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d97a60>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:08.148010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:08.148815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:08.160395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:08.161244 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:08.162229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:08.170661 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:08.250441 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dec5bf83-5f4f-4e33-9a88-8bfd48d0af87 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 202 len: 0 microversion: 2.1 time: 0.153145 Jul 25 19:07:08.251050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:08.256219 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 214/423] 10.222.0.17 () {58 vars in 1254 bytes} [Mon Jul 25 19:07:08 2022] DELETE /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:07:08.263386 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dc091872-59f8-4319-b04b-28e82667380c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e6039310>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:08.267929 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c9bfba5b-f08c-4e84-8bf2-29331e746045 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1279 microversion: 2.1 time: 0.132566 Jul 25 19:07:08.268549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 210/424] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:08 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:08.311373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dc091872-59f8-4319-b04b-28e82667380c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.053445 Jul 25 19:07:08.312132 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 215/425] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:08 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:08.385495 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:08.386013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:08.392946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:08.393386 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:08.394268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:08.394757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:08.634272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:08.634918 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:08.642048 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:08.642687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:08.643320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:08.644116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:08.644607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:08.653169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5c25db9d-be5d-4d2e-a65a-0acb567a8703 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.271298 Jul 25 19:07:08.653864 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 211/426] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:08 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:08.786688 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:08.790740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:08.795188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1373f076-5e01-491c-a035-cba23d8b246a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.165255 Jul 25 19:07:08.795763 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 216/427] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:08 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:09.291040 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:09.291777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:09.299194 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:09.299645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:09.300414 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:09.300841 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:09.303827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:09.324651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1d4756d5-08e6-446a-8fd5-a6a7a60adfcf tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e6012040>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:09.355978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1d4756d5-08e6-446a-8fd5-a6a7a60adfcf tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.035109 Jul 25 19:07:09.356532 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 217/428] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:09 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:09.454290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:09.462103 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9f15437c-f945-4bbd-bef5-8a2070424ee2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.174925 Jul 25 19:07:09.462725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 212/429] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:09 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:09.675841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:09.676356 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:09.682503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:09.683014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:09.683729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:09.684165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:09.817085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:09.817885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:09.821674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:09.824497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:09.824944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:09.825717 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:09.826148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:09.831577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ade62556-36f1-4ad2-b2bc-4df09249f99e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.160498 Jul 25 19:07:09.834916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 218/430] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:09 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:10.177251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:10.184844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6535a528-4400-43af-9d43-1215baffa009 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.372482 Jul 25 19:07:10.185426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 213/431] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:09 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:10.369723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4f2acd4b-1222-4172-bc54-2a112b8ff8be tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d238b0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:10.401076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4f2acd4b-1222-4172-bc54-2a112b8ff8be tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.035323 Jul 25 19:07:10.401681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 219/432] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:10 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:10.490627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:10.490627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:10.492096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:10.492533 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:10.493292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:10.493744 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:10.631615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:10.642035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d6bd94bb-58e3-4326-ba60-b80cc9dccac8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.161335 Jul 25 19:07:10.644257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 214/433] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:10 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:10.855203 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:10.855968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:10.863241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:10.863688 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:10.864471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:10.864903 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:11.021176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:11.028600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9a145d4a-4733-4835-9123-a7970815843e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.177567 Jul 25 19:07:11.029297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 220/434] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:10 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:11.206616 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:11.207131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:11.213394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:11.213831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:11.214625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:11.215056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:11.361514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:11.369452 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a1537246-a4ed-4301-be87-19f175fbd3cf tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.166872 Jul 25 19:07:11.370039 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 215/435] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:11 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:11.415561 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9513e8f3-320c-4b68-be7f-582d719c321d tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2b1f0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:11.450047 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9513e8f3-320c-4b68-be7f-582d719c321d tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.038644 Jul 25 19:07:11.450663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 221/436] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:11 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:11.664198 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:11.664796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:11.672274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:11.672485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:11.673306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:11.673884 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:11.811272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:11.819841 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-349fe293-fffd-4869-82ba-0dd7bf7e17aa tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.159438 Jul 25 19:07:11.820415 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 216/437] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:11 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:12.052455 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:12.052974 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:12.059146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:12.059601 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:12.060379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:12.060833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:12.195472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:12.203946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-07141dbf-e406-4b47-b21e-f7ee4207dfb5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.155339 Jul 25 19:07:12.205435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 222/438] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:12 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:12.391454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:12.391978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:12.398377 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:12.398824 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:12.399667 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:12.400097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:12.463428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fb2a149c-14bd-4bb9-b86e-86b7ca4886ff tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2d790>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:12.498148 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fb2a149c-14bd-4bb9-b86e-86b7ca4886ff tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.038604 Jul 25 19:07:12.498832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 223/439] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:12 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:12.543061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:12.551636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fb105e36-ecb1-4a92-a49e-403ce37383a3 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.164272 Jul 25 19:07:12.552381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 217/440] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:12 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:12.841387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:12.842070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:12.849898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:12.850379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:12.851249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:12.851694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:12.992524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:13.000452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5c432e05-d3eb-4b38-a181-6446529c5b02 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.163064 Jul 25 19:07:13.001032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 224/441] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:12 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:13.227825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:13.228531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:13.235817 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:13.236266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:13.237035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:13.237459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:13.379212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:13.387551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-117630cd-c219-45ee-add6-6c2397c939b7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.163691 Jul 25 19:07:13.388420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 218/442] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:13 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:13.512645 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-614669ed-ce54-4dde-ab7b-e5f975427e6c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2db80>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:13.544535 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-614669ed-ce54-4dde-ab7b-e5f975427e6c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.035870 Jul 25 19:07:13.545589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 225/443] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:13 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:13.573305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:13.573976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:13.581147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:13.581625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:13.582757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:13.583210 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:13.725145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:13.732761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c0219992-85e6-4457-8a2a-6861571aef93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.163398 Jul 25 19:07:13.733323 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 219/444] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:13 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:14.022350 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:14.022971 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:14.029095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:14.029541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:14.030310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:14.030823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:14.171432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:14.179460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3b108a5e-f8b5-49fe-82bd-182eaad846c2 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.160937 Jul 25 19:07:14.180042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 226/445] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:14 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:14.412792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:14.413700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:14.420837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:14.422208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:14.423708 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:14.424463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:14.558974 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-39acee17-7c90-4baa-a3ce-c1d1a4ad5e13 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d55ca0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:14.592622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-39acee17-7c90-4baa-a3ce-c1d1a4ad5e13 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.037705 Jul 25 19:07:14.593479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 227/446] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:14 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:14.655166 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:14.663352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fccde945-fdee-4aed-853f-5ac635863b77 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.257892 Jul 25 19:07:14.663971 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 220/447] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:14 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:14.755169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:14.755769 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:14.762175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:14.762654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:14.763436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:14.763861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:14.960996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:14.969769 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2515f3b6-f39b-4ced-ac74-b47a4e84444d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.218426 Jul 25 19:07:14.970372 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 228/448] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:14 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:15.180002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-d9d0486e-8da9-4a67-891d-0f07d7b68759 req-0eac9b2c-ebef-4868-8a4f-0813cf4837eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817e855e-4d22-4477-ac1a-c8e368f8cb70", "tag": "966af95a-bc29-41c4-a594-5ac6825a7c2f"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:15.191020 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d9d0486e-8da9-4a67-891d-0f07d7b68759 req-0eac9b2c-ebef-4868-8a4f-0813cf4837eb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:15.191489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d9d0486e-8da9-4a67-891d-0f07d7b68759 req-0eac9b2c-ebef-4868-8a4f-0813cf4837eb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:15.204732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-d9d0486e-8da9-4a67-891d-0f07d7b68759 req-0eac9b2c-ebef-4868-8a4f-0813cf4837eb service nova] Creating event network-changed:966af95a-bc29-41c4-a594-5ac6825a7c2f for instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 on hv-cinder-82002 Jul 25 19:07:15.206899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:15.207758 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:15.209976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-d9d0486e-8da9-4a67-891d-0f07d7b68759 req-0eac9b2c-ebef-4868-8a4f-0813cf4837eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034116 Jul 25 19:07:15.210790 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 221/449] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:15.213931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:15.214505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:15.215176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:15.215602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:15.362986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:15.371388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7afb1aa9-8677-4121-a977-1bf26463d11c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.168679 Jul 25 19:07:15.371967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 229/450] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:15 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:15.612522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6b73520f-967d-4fc9-a3e5-525abbee2d9c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e66cbc10>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:15.651793 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6b73520f-967d-4fc9-a3e5-525abbee2d9c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 200 len: 286 microversion: 2.1 time: 0.048499 Jul 25 19:07:15.652356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 222/451] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:15 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:15.686686 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:15.688015 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:15.694898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:15.695336 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:15.696103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:15.696527 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:15.847141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:15.854823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ce55e574-54e8-4ac5-85ea-5c335a8d91bb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.172075 Jul 25 19:07:15.855406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 230/452] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:15 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:15.991460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:15.992257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:15.998785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:15.999229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:16.000327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:16.000562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:16.194815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:16.204293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ed90d9a2-1c18-4961-a57a-bb1f4cbedff8 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.216854 Jul 25 19:07:16.205223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 223/453] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:15 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:16.393513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:16.394134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:16.400603 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:16.401054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:16.401955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:16.402608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:16.549010 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:16.556836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-11258d29-e764-4a22-95b6-48f2842fa6dd tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.167961 Jul 25 19:07:16.557405 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 231/454] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:16 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:16.665420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ab6c8895-ef18-48b4-8698-8a5ccd4e007c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e68014c0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:16.696864 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-ab6c8895-ef18-48b4-8698-8a5ccd4e007c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] HTTP exception thrown: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ab6c8895-ef18-48b4-8698-8a5ccd4e007c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Request method failure captured: Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da HTTP/1.1 Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3unL00oR9Qdru0pfxTTGGz5Z1_8j5GnwrZYzLE3svagVx-STF9RbiKC20VElSFkQiOFq1nWS6x1Fr3n2WyrA8nzdEEUln7r2A-0YWBC0CD95XpJQvXtxgqNZ8ziiW9ChFNtkra1TjLPRnk8B3lBsBBwwmnxuo-BpGyWeigbRc1oGRTs Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:07:16.699919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffe03884791a4cb795e8e10341a04d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: b146639c09014f6ea15b742abc977492 Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'a945d938-c186-48a0-8d8b-a874c21b76da'} Jul 25 19:07:16.703375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. (HTTP 404) (Request-ID: req-944afdbd-25e1-4750-a8ba-e2a0b929976f) Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.704271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:07:16.705282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 19:07:16.706939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ab6c8895-ef18-48b4-8698-8a5ccd4e007c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Returning 404 to user: Snapshot a945d938-c186-48a0-8d8b-a874c21b76da could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ab6c8895-ef18-48b4-8698-8a5ccd4e007c tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da" status: 404 len: 111 microversion: 2.1 time: 0.039630 Jul 25 19:07:16.708195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 224/455] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:07:16 2022] GET /compute/v2.1/os-snapshots/a945d938-c186-48a0-8d8b-a874c21b76da => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:07:16.711687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-09f39267-aaed-49d8-856f-dffbf1505f73 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5ceb790>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:16.877305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:16.877932 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:16.887101 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:16.887562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:16.888406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:16.888838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:16.929681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-09f39267-aaed-49d8-856f-dffbf1505f73 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 202 len: 0 microversion: 2.1 time: 0.221613 Jul 25 19:07:16.933808 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 232/456] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:07:16 2022] DELETE /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:07:16.940807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-31919186-95c4-40da-a67b-6bb35cbb7c58 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5f3e280>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:17.002720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-31919186-95c4-40da-a67b-6bb35cbb7c58 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.067309 Jul 25 19:07:17.003204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 233/457] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:16 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:17.052817 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:17.062011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c18736c4-862c-4b62-ad75-18bca1a40b67 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1501 microversion: 2.1 time: 0.188445 Jul 25 19:07:17.063441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 225/458] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:16 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:17.085332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67ea1353-309d-47c9-8ff6-e19b2d210388"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:17.088262 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:17.096641 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.097202 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.098196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.098984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.125623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] HTTP exception thrown: Cannot 'attach_volume' instance bffab6ed-1699-49d7-bee1-73e045f1e868 while it is in vm_state rescued Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Request method failure captured: Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/os-volume_attachments HTTP/1.1 Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 74 Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk6qrggI4ZdDZ3OljzMTvskbV_LrBAkfnST4XU-fpRTsNtG_FLto1q8CTbpeh4sh1JrPNS-rCyPw8VIidTfhG6Z7zd6g581q-F-CAMVpo-QrvhvSVGMCUcHuveYvtEA543E-TYXD6laTWuEeEs15TXe4KklGT0yFfbFtxM_8cV2CSY Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:07:17.127679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08c6be8edb884214bae7a0abbf97dc16", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 7e3f168283ba4f159948830f396ae7cf Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {"volumeAttachment": {"volumeId": "67ea1353-309d-47c9-8ff6-e19b2d210388"}} Jul 25 19:07:17.129682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Cannot 'attach_volume' instance bffab6ed-1699-49d7-bee1-73e045f1e868 while it is in vm_state rescued Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'server_id': 'bffab6ed-1699-49d7-bee1-73e045f1e868', 'body': {'volumeAttachment': {'volumeId': '67ea1353-309d-47c9-8ff6-e19b2d210388'}}} Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:07:17.130434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bffab6ed-1699-49d7-bee1-73e045f1e868 while it is in vm_state rescued Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:17.131597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bffab6ed-1699-49d7-bee1-73e045f1e868 while it is in vm_state rescued Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Returning 409 to user: Cannot 'attach_volume' instance bffab6ed-1699-49d7-bee1-73e045f1e868 while it is in vm_state rescued {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cbfd98bc-57eb-435e-9884-5bbb497057a1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048128 Jul 25 19:07:17.133004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 234/459] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:07:17 2022] POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 19:07:17.143773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:17.144084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:17.157193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.157515 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.158304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.159416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.239196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:17.239805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:17.246449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.246914 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.247715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.248146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.419333 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:17.429842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-acf715b0-9f6d-4a63-82ba-d20533a666f9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/action" status: 202 len: 0 microversion: 2.1 time: 0.293537 Jul 25 19:07:17.430744 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0d86c7b1-9245-4874-947a-e6413729fe72 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.195194 Jul 25 19:07:17.434093 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 235/461] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:17 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:17.434307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 226/460] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:07:17 2022] POST /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:07:17.441862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:17.442559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:17.449374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.449851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.451246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.451246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.578627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:17.579331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:17.588362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.588362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.588362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:17.588362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:17.614901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:17.627121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c177dd78-2826-44b7-8ab4-0ff065256adf tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.190926 Jul 25 19:07:17.628181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 236/462] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:17 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:17.755437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:17.763287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-417fc075-fe09-4523-9d6a-c93703b7c209 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.188995 Jul 25 19:07:17.777123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 227/463] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:17 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:18.018265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-82cf913f-4d28-471a-9de1-fcb5e43b6b11 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d979d0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:18.068622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-82cf913f-4d28-471a-9de1-fcb5e43b6b11 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.055068 Jul 25 19:07:18.069455 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 237/464] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:18 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:18.457045 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:18.458028 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:18.459869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=84 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:18.464851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:18.465290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:18.466056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:18.466517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:18.616832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:18.625326 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-12534eda-458a-4a12-909a-0c29600e735f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.172000 Jul 25 19:07:18.626170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 228/465] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:18 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:18.656889 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:18.657507 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:18.663913 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:18.664361 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:18.665170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:18.665607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:18.786186 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:18.786861 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:18.792987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:18.793432 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:18.794201 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:18.794741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:18.808780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:18.816844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7bcaabc9-636a-4b4c-b2d8-ee2b21786fdd tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.164209 Jul 25 19:07:18.817425 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 238/466] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:18 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:18.934447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:18.942254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-92ae60eb-38a1-4467-9ff6-e6c21bde1c8e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.160297 Jul 25 19:07:18.942850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 229/467] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:18 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:19.083938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ee694f98-c603-49d5-bd0c-1ba0bf72d302 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d97e50>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:19.134206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ee694f98-c603-49d5-bd0c-1ba0bf72d302 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.054199 Jul 25 19:07:19.134809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 239/468] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:19 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:19.649171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:19.650069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:19.658527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:19.659108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:19.660042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:19.660581 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:19.681284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:19.841495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:19.842921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:19.858479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:19.859771 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:19.860782 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:19.861510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:19.862314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:19.869545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-970833e7-bfbe-4265-af9f-83d9a8c2adde tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.225570 Jul 25 19:07:19.870120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 230/469] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:19 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:19.965633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:19.966246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:19.973881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:19.974311 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:19.975110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:19.975543 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:20.068879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:20.077851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a52d0366-ca7d-40bb-bad2-9794b3b5d60f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.240461 Jul 25 19:07:20.081424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 240/470] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:19 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:20.153631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7ef2e90a-643f-40e4-867d-2bdb0b7ba453 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d2daf0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:20.177148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:20.185503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-abb8acf4-8102-4d7c-b7b2-6e4b498eca52 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.224265 Jul 25 19:07:20.186098 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 231/471] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:19 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:20.214730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7ef2e90a-643f-40e4-867d-2bdb0b7ba453 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.066329 Jul 25 19:07:20.215308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 241/472] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:20 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:20.897684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:20.898357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:20.905704 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:20.906147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:20.906945 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:20.907379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:21.054227 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:21.063034 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-347c078f-b721-48cc-a8d9-fbe8585d6086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.168321 Jul 25 19:07:21.063281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 232/473] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:20 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:21.100000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:21.100607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:21.106900 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:21.107347 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:21.108113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:21.108554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:21.208943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:21.209586 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:21.216055 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:21.216589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:21.217441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:21.217951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:21.257795 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:21.265823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a4580e47-adbc-4bf2-9b0d-8fdf986b4048 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.169607 Jul 25 19:07:21.267376 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 242/474] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:21 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:21.272598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e843f874-7fc6-413e-a46c-0588285cc52e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5cebaf0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:21.327735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e843f874-7fc6-413e-a46c-0588285cc52e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.059006 Jul 25 19:07:21.328341 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 243/475] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:21 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:21.365535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:21.373020 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1d98fa7d-5cc4-4116-9c9c-6bcb3a558601 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.168456 Jul 25 19:07:21.373581 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 233/476] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:21 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:22.085687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:22.086200 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:22.092651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:22.093140 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:22.093920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:22.094374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:22.232855 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:22.241503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-59c3ff69-ef48-43ca-b169-180533b51a95 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.159736 Jul 25 19:07:22.242290 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 244/477] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:22 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:22.288303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:22.288961 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:22.295008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:22.295444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:22.296912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:22.297470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:22.341862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-150e447a-2c50-4b50-98b5-ce265cc58bf6 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5ceb1f0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:22.394628 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-150e447a-2c50-4b50-98b5-ce265cc58bf6 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.056711 Jul 25 19:07:22.395267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 245/478] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:22 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:22.399996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:22.411342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:22.411342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:22.411342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:22.411342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:22.411829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:22.444989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:22.452805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a8549120-e5e8-4e2f-9a18-9b51223e74c1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.168393 Jul 25 19:07:22.453348 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 234/479] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:22 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:22.547866 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:22.551395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:22.555800 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-988077e7-b31a-4228-bd0b-4f1660a63cd9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.159605 Jul 25 19:07:22.556574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 246/480] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:22 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:23.263561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:23.264225 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:23.270782 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:23.271227 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:23.272000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:23.272461 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:23.414363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:23.420646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b7956485-34b0-4e51-89bf-8457e122cc45 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5fb93a0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:23.424569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-801ba008-0ed5-465c-9687-249a912d7078 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1314 microversion: 2.1 time: 0.164951 Jul 25 19:07:23.444308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 235/481] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:23 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:23.476293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:23.476709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:23.483102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:23.484285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:23.485476 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:23.485919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:23.496149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b7956485-34b0-4e51-89bf-8457e122cc45 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.087528 Jul 25 19:07:23.496149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 247/482] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:23 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:23.579292 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:23.580326 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:23.589791 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:23.590254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:23.591119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:23.591576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:23.646907 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:23.659890 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-aa8f74bb-f88e-40ef-a072-ae758f2a740a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.187693 Jul 25 19:07:23.661726 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 236/483] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:23 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:23.745739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:23.754584 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dc8ff195-8e69-47ca-8918-5559198ff65a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.180480 Jul 25 19:07:23.766101 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 248/484] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:23 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:24.449511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:24.450262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:24.461134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:24.461583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:24.462435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:24.462873 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:24.508386 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aba32083-6f89-43ec-abf4-e229fa4b1990 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5d97e50>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:24.606837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-aba32083-6f89-43ec-abf4-e229fa4b1990 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 200 len: 344 microversion: 2.1 time: 0.102802 Jul 25 19:07:24.607735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 249/485] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:24 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:07:24.684291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:24.685657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:24.698523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:24.699964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:24.701290 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:24.702236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:24.815935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:24.825362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4b7031f5-530e-495e-8172-569e443bab77 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1498 microversion: 2.1 time: 0.381390 Jul 25 19:07:24.826232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 237/486] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:24 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1498 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:24.831571 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:24.832202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:24.839630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:24.840344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:24.841196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:24.841702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:24.864589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:24.874910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6be8da22-9af1-496d-9440-5c0df37c17f7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.195799 Jul 25 19:07:24.876139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 250/487] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:24 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:24.995079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:25.002862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d50d1999-09b8-4a90-91df-f0bfb19d4756 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.175547 Jul 25 19:07:25.003686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 238/488] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:24 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:25.622130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a9cf4a7b-7c49-498e-82a7-db7b1b2b937e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e6039430>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:25.651839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-a9cf4a7b-7c49-498e-82a7-db7b1b2b937e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] HTTP exception thrown: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a9cf4a7b-7c49-498e-82a7-db7b1b2b937e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Request method failure captured: Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b HTTP/1.1 Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3unL00oR9Qdru0pfxTTGGz5Z1_8j5GnwrZYzLE3svagVx-STF9RbiKC20VElSFkQiOFq1nWS6x1Fr3n2WyrA8nzdEEUln7r2A-0YWBC0CD95XpJQvXtxgqNZ8ziiW9ChFNtkra1TjLPRnk8B3lBsBBwwmnxuo-BpGyWeigbRc1oGRTs Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:07:25.653761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffe03884791a4cb795e8e10341a04d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: b146639c09014f6ea15b742abc977492 Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '90c75c15-d927-449b-b672-161850e5036b'} Jul 25 19:07:25.655673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. (HTTP 404) (Request-ID: req-48ba9f96-d300-4329-940a-090722ef5a40) Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.656684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:07:25.658163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 19:07:25.659542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a9cf4a7b-7c49-498e-82a7-db7b1b2b937e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Returning 404 to user: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a9cf4a7b-7c49-498e-82a7-db7b1b2b937e tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 404 len: 109 microversion: 2.1 time: 0.036908 Jul 25 19:07:25.660886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 251/489] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:25 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:07:25.671563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c7f3dc6-2a34-40e2-aa2c-d41a88c8dde4 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e65abe50>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:25.701070 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-9c7f3dc6-2a34-40e2-aa2c-d41a88c8dde4 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] HTTP exception thrown: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c7f3dc6-2a34-40e2-aa2c-d41a88c8dde4 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Request method failure captured: Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: DELETE /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b HTTP/1.1 Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3unL00oR9Qdru0pfxTTGGz5Z1_8j5GnwrZYzLE3svagVx-STF9RbiKC20VElSFkQiOFq1nWS6x1Fr3n2WyrA8nzdEEUln7r2A-0YWBC0CD95XpJQvXtxgqNZ8ziiW9ChFNtkra1TjLPRnk8B3lBsBBwwmnxuo-BpGyWeigbRc1oGRTs Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:07:25.704306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffe03884791a4cb795e8e10341a04d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: b146639c09014f6ea15b742abc977492 Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '90c75c15-d927-449b-b672-161850e5036b'} Jul 25 19:07:25.705804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. (HTTP 404) (Request-ID: req-4738f610-19db-43c8-8bca-1a8e4eb1fffd) Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.706691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 19:07:25.707981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 19:07:25.709260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c7f3dc6-2a34-40e2-aa2c-d41a88c8dde4 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Returning 404 to user: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9c7f3dc6-2a34-40e2-aa2c-d41a88c8dde4 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 404 len: 109 microversion: 2.1 time: 0.038958 Jul 25 19:07:25.710522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 239/490] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:07:25 2022] DELETE /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:07:25.714615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ab20b8e8-4fb7-49b5-8050-dc603eb1a623 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Calling method '.version_select at 0x7fd8e5ced940>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:25.764282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:25.765455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:25.768546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-ab20b8e8-4fb7-49b5-8050-dc603eb1a623 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] HTTP exception thrown: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ab20b8e8-4fb7-49b5-8050-dc603eb1a623 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Request method failure captured: Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b HTTP/1.1 Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3unL00oR9Qdru0pfxTTGGz5Z1_8j5GnwrZYzLE3svagVx-STF9RbiKC20VElSFkQiOFq1nWS6x1Fr3n2WyrA8nzdEEUln7r2A-0YWBC0CD95XpJQvXtxgqNZ8ziiW9ChFNtkra1TjLPRnk8B3lBsBBwwmnxuo-BpGyWeigbRc1oGRTs Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:07:25.770981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffe03884791a4cb795e8e10341a04d95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffe03884791a4cb795e8e10341a04d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: ffe03884791a4cb795e8e10341a04d95 Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-11396514 Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: b146639c09014f6ea15b742abc977492 Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesSnapshotsTestJSON-11396514-project Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '90c75c15-d927-449b-b672-161850e5036b'} Jul 25 19:07:25.772240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. (HTTP 404) (Request-ID: req-287abe35-d774-47e7-bb09-e3859399e2cc) Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.773139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:07:25.774254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 19:07:25.779629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ab20b8e8-4fb7-49b5-8050-dc603eb1a623 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] Returning 404 to user: Volume 90c75c15-d927-449b-b672-161850e5036b could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ab20b8e8-4fb7-49b5-8050-dc603eb1a623 tempest-VolumesSnapshotsTestJSON-11396514 tempest-VolumesSnapshotsTestJSON-11396514-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b" status: 404 len: 109 microversion: 2.1 time: 0.061855 Jul 25 19:07:25.781964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 252/491] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:07:25 2022] GET /compute/v2.1/os-volumes/90c75c15-d927-449b-b672-161850e5036b => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:07:25.782893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:25.782893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:25.782893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:25.782893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:25.807531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:07:25.899360 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:25.899973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:25.906638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:25.907075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:25.908649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:25.908649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:26.051008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:26.058608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-94637f1b-0c53-4af8-ad9b-597edb0bf87f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.163061 Jul 25 19:07:26.059167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 253/492] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:25 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:26.064261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:26.064861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:26.071065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:26.071506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:26.072265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:26.072693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:26.203257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8473c3cd-3eca-4379-acf0-1dbf49910830 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 204 len: 0 microversion: 2.1 time: 0.442636 Jul 25 19:07:26.203959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 240/493] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:07:25 2022] DELETE /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:07:26.217820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:26.219024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:26.219024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:26.220261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:26.220706 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:26.221223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-86127f98-d753-41af-9f76-49e25d42b190 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.160815 Jul 25 19:07:26.221465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:26.221569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 254/494] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:26 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:26.221899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:26.360861 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:26.368675 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6de6a977-bd85-4206-8780-90b2fb0f3289 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.159962 Jul 25 19:07:26.368675 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 241/495] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:26 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:27.081896 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:27.082604 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:27.085065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=76 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:27.090136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:27.101743 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:27.101743 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:27.101743 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:27.244178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:27.244914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:27.254629 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:27.255082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:27.255909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:27.257820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:27.260960 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:27.270103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0a3a132e-8c70-43e7-adc2-0edb2e4504ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.192817 Jul 25 19:07:27.270767 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 255/496] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:27 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:27.391936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:27.392587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:27.403906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:27.404649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:27.407023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:27.408059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:27.429323 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:27.441651 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-de43c546-9423-432c-8a19-dc930fb8cf22 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.202327 Jul 25 19:07:27.442483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 242/497] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:27 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:27.590105 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:27.597959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7f374f1b-a9c3-49d3-ba19-2eeea623233a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.211546 Jul 25 19:07:27.598542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 256/498] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:27 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:28.295969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:28.296693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:28.303777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:28.304222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:28.311474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:28.311474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:28.456952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:28.464524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-50b5f45b-e370-47c5-88f9-dae2564f0ece tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.172703 Jul 25 19:07:28.465078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 243/499] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:28 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:28.481469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:28.484117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:28.490233 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:28.490895 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:28.491657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:28.492165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:28.619677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:28.620304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:28.627209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:28.627670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:28.628478 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:28.628912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:28.641435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:28.649151 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8407f658-bfa5-4196-b99f-74c3c4e16aaf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.172823 Jul 25 19:07:28.649819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 257/500] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:28 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:28.775205 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:28.783916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f44aef38-8458-4cfe-8dd8-0ce317567e93 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.168132 Jul 25 19:07:28.784492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 244/501] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:28 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:29.497730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:29.498545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:29.507698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:29.508143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:29.508918 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:29.509352 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:29.671029 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:29.673264 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:29.683966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:29.684446 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:29.685313 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:29.685754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:29.698841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:29.708592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fadb7f72-b8c0-4975-bb46-0e60add07888 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.215118 Jul 25 19:07:29.711909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 258/502] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:29 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:29.808663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:29.809317 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:29.819310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:29.820716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:29.822408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:29.823063 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:29.909367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:29.918863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-11482a50-f71d-45b0-ae2c-fc92107308e1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.251591 Jul 25 19:07:29.919560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 245/503] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:29 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:30.008533 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:30.022227 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-be361cc4-e2b7-4f73-8f0d-756ecaf12614 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.220131 Jul 25 19:07:30.023576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 259/504] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:29 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:30.737528 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:30.738373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:30.746294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:30.746890 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:30.752017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:30.752017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:30.769820 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.914203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:30.924182 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ba350727-d03b-41dc-bc53-d58d94909120 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.191363 Jul 25 19:07:30.924849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 246/505] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:30 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:30.948870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:30.950306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:30.959628 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:30.962415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:30.962415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:30.962415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:31.048474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:31.049110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:31.056177 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:31.056625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:31.058413 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:31.058413 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:31.198197 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:31.205784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5135fe56-7139-4c50-b6bb-2d4a631762c3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.261657 Jul 25 19:07:31.206389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 260/506] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:30 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:31.241783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:31.254763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8d8c3467-a278-44fd-8599-554c659f2a4d tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.206843 Jul 25 19:07:31.254763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 247/507] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:31 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:31.950516 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:31.951181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:31.968313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:31.972119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:31.972119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:31.972119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:32.118654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:32.127367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1425b1bc-cf1c-44e2-b350-ef7b32572e9e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.180718 Jul 25 19:07:32.128108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 261/508] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:31 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:32.228590 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:32.229222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:32.236315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:32.236751 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:32.237585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:32.238011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:32.280524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:32.281843 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:32.291472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:32.292600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:32.295235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:32.295235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:32.406496 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:32.415686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8d7dd44a-54bf-46f9-9f2c-b52dfd590348 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.191162 Jul 25 19:07:32.432970 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 248/509] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:32 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:32.490217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:32.497720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4162acc3-018b-4bba-b577-ddf0125d8a1a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.228486 Jul 25 19:07:32.498279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 262/510] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:32 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:32.624426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-94328a6d-9470-4e70-bcd0-b45c6d7e7c43 req-94d49f40-3d9f-4f19-8af7-eba9419e459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817e855e-4d22-4477-ac1a-c8e368f8cb70", "name": "network-vif-plugged", "status": "completed", "tag": "966af95a-bc29-41c4-a594-5ac6825a7c2f"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:32.637181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-94328a6d-9470-4e70-bcd0-b45c6d7e7c43 req-94d49f40-3d9f-4f19-8af7-eba9419e459a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:32.637646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-94328a6d-9470-4e70-bcd0-b45c6d7e7c43 req-94d49f40-3d9f-4f19-8af7-eba9419e459a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:32.649626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-94328a6d-9470-4e70-bcd0-b45c6d7e7c43 req-94d49f40-3d9f-4f19-8af7-eba9419e459a service nova] Creating event network-vif-plugged:966af95a-bc29-41c4-a594-5ac6825a7c2f for instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 on hv-cinder-82002 Jul 25 19:07:32.654624 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-94328a6d-9470-4e70-bcd0-b45c6d7e7c43 req-94d49f40-3d9f-4f19-8af7-eba9419e459a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Jul 25 19:07:32.655147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 249/511] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:33.149642 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:33.150432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:33.158700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:33.159198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:33.161064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:33.161503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:33.298237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:33.306607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2b164ca9-4fdc-4309-b0b9-b5496a86c604 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.160826 Jul 25 19:07:33.307229 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 263/512] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:33 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:33.442202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:33.443550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:33.449535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:33.449979 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:33.450777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:33.451212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:33.519392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:33.520025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:33.526440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:33.527365 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:33.528001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:33.528587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:33.594407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:33.605421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9b7970a6-9bb9-4738-b221-d9d09a5f7f15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.168734 Jul 25 19:07:33.606014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 250/513] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:33 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:33.689703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:33.697418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ce7d3131-37ce-48c1-8e65-af0295e4272a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.182041 Jul 25 19:07:33.697923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 264/514] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:33 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:34.329430 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:34.330181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:34.338384 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:34.338836 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:34.339620 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:34.340054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:34.492978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:34.501995 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-66e64763-51e4-41e7-8559-3a5c1333c797 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.177283 Jul 25 19:07:34.502678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 251/515] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:34 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:34.627837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:34.628619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:34.637102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:34.650540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:34.650540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:34.650540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:34.720271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:34.720886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:34.727949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:34.728406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:34.729195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:34.729628 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:34.812167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:34.820988 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a6e93da9-7b03-45da-8a0a-a010dc5d601e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.197203 Jul 25 19:07:34.821295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 265/516] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:34 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:34.888723 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:34.897388 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d86e8487-6b55-46e1-9c66-57ae20136658 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.181505 Jul 25 19:07:34.897984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 252/517] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:34 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:35.524336 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:35.524937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:35.531285 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:35.531727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:35.532493 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:35.532924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:35.690238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:35.699274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-08b10c54-3812-4023-9a94-5f634be9bbdb tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.179164 Jul 25 19:07:35.699847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 266/518] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:35 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:35.847797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:35.848453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:35.854738 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:35.855176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:35.855934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:35.856381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:35.919299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:35.919917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:35.926521 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:35.926954 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:35.927957 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:35.928436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:35.949929 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:36.011422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:36.019344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-23ceb3f5-d494-4f70-905f-e18b813061d6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.175500 Jul 25 19:07:36.019885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 253/519] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:35 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:36.073961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:36.082310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-340b2bd5-385f-4eb1-96f8-ecb535949326 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.166887 Jul 25 19:07:36.082904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 267/520] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:35 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:36.725080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:36.725800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:36.732326 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:36.732763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:36.733567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:36.734799 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:36.880896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:36.890652 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4f557446-02fc-40be-8669-e463710bea20 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.168762 Jul 25 19:07:36.891258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 254/521] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:36 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:37.048057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:37.048932 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:37.055931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:37.056381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:37.057169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:37.057602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:37.105956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:37.106710 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:37.114079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:37.114712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:37.116197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:37.116764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:37.213793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:37.223132 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-502d6436-db95-45e9-96d2-2db1c30a57bc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.181886 Jul 25 19:07:37.223717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 268/522] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:37 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:37.297236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:37.305780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a15fa19a-429f-4290-817b-abfa8ce708e7 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.206131 Jul 25 19:07:37.306573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 255/523] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:37 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:37.913335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:37.913937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:37.920120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:37.920557 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:37.921823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:37.922368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:38.079659 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:38.088522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-424a92fd-da36-4dcf-a2d0-81a1911ecd60 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.178895 Jul 25 19:07:38.088867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 269/524] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:37 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:38.246871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:38.247483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:38.256989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:38.262468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:38.263276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:38.263715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:38.329244 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:38.329763 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:38.336247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:38.336948 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:38.338074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:38.338743 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:38.404024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:38.411795 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dfaecf39-85a0-4f08-89f9-33203b2ecc6b tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.168624 Jul 25 19:07:38.412394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 256/525] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:38 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:38.477042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:38.485210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-da5c9179-d5f3-490d-a1b2-fda389b0d778 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.160643 Jul 25 19:07:38.485783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 270/526] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:38 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:38.875522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-ca10f27b-7a36-409b-9169-ff08e9a94c5c req-e8e748a3-4713-4b2b-8e97-4b39d11f868d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb463f9-92ba-4071-9aa5-a1bdccc80710", "name": "network-vif-unplugged", "status": "completed", "tag": "9dde897b-8e86-4be3-af08-f8cc6a7ba614"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:38.886835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-ca10f27b-7a36-409b-9169-ff08e9a94c5c req-e8e748a3-4713-4b2b-8e97-4b39d11f868d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:38.887327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-ca10f27b-7a36-409b-9169-ff08e9a94c5c req-e8e748a3-4713-4b2b-8e97-4b39d11f868d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:38.900825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-ca10f27b-7a36-409b-9169-ff08e9a94c5c req-e8e748a3-4713-4b2b-8e97-4b39d11f868d service nova] Creating event network-vif-unplugged:9dde897b-8e86-4be3-af08-f8cc6a7ba614 for instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 on hv-cinder-82002 Jul 25 19:07:38.907284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-ca10f27b-7a36-409b-9169-ff08e9a94c5c req-e8e748a3-4713-4b2b-8e97-4b39d11f868d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036313 Jul 25 19:07:38.907947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 257/527] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:39.110678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:39.111556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:39.119084 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:39.119494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:39.120377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:39.120808 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:39.274187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:39.282927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7e5cc9d5-d2c0-49c7-b29d-c844f0a6f622 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.176753 Jul 25 19:07:39.283800 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 271/528] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:39 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:39.434680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:39.435474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:39.443128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:39.443594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:39.444350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:39.444803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:39.507059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:39.507881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:39.514167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:39.514642 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:39.516033 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:39.516582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:39.649125 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:39.660575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4713b7d2-085c-445a-af30-5f5526b58a15 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.230247 Jul 25 19:07:39.661162 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 258/529] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:39 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:39.750977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:39.759146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-70bf7e16-d112-48d5-a426-c2b678d1b086 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.256301 Jul 25 19:07:39.759718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 272/530] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:39 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:40.307175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:40.307785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:40.314612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:40.315090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:40.315862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:40.316350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:40.475096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:40.487611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4d3c7f6d-e69f-4d36-bdbf-866d8eaea18f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1509 microversion: 2.1 time: 0.184322 Jul 25 19:07:40.502791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 259/531] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:40 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:40.683923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:40.684609 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:40.693006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:40.693458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:40.694221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:40.694672 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:40.784498 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:40.785594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:40.793904 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:40.794648 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:40.795547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:40.796112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:40.922234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:40.934762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7942d072-c189-4e25-a578-11c76c66f92e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.254498 Jul 25 19:07:40.938768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 273/532] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:40 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:41.043091 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:41.043091 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4adb78de-b94b-4147-b75c-084c7d7b8b15 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1504 microversion: 2.1 time: 0.264705 Jul 25 19:07:41.043091 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 260/533] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:40 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:41.489443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-d9733c33-bef1-430c-b14f-0527a0e2d93d req-9efe3bb9-8588-45d2-878b-13b36a9f8925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb463f9-92ba-4071-9aa5-a1bdccc80710", "name": "network-vif-deleted", "tag": "9dde897b-8e86-4be3-af08-f8cc6a7ba614"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:41.500673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d9733c33-bef1-430c-b14f-0527a0e2d93d req-9efe3bb9-8588-45d2-878b-13b36a9f8925 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:41.501116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d9733c33-bef1-430c-b14f-0527a0e2d93d req-9efe3bb9-8588-45d2-878b-13b36a9f8925 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:41.510383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:41.510985 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:41.513430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-d9733c33-bef1-430c-b14f-0527a0e2d93d req-9efe3bb9-8588-45d2-878b-13b36a9f8925 service nova] Creating event network-vif-deleted:9dde897b-8e86-4be3-af08-f8cc6a7ba614 for instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 on hv-cinder-82002 Jul 25 19:07:41.519246 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-d9733c33-bef1-430c-b14f-0527a0e2d93d req-9efe3bb9-8588-45d2-878b-13b36a9f8925 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033440 Jul 25 19:07:41.519590 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:41.519850 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 274/534] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:41.520036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:41.524063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:41.524063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:41.695737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:41.705386 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b6ac454a-a3be-4bef-88a5-5fc440f63ffe tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1515 microversion: 2.1 time: 0.199008 Jul 25 19:07:41.705988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 261/535] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:41 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:41.958625 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:41.959421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:41.966674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:41.967145 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:41.967925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:41.969267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:42.069852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:42.070495 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:42.077373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:42.078550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:42.079355 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:42.080021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:42.143213 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:42.151298 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2c06c906-07eb-46fa-bb84-2c6e63458419 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.197293 Jul 25 19:07:42.151915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 275/536] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:41 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:42.166472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:42.172691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-67076e8f-3939-417f-a873-33213e84c032 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1462 microversion: 2.1 time: 0.102272 Jul 25 19:07:42.172691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 262/537] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:42 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:43.176505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:43.177109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:43.183748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:43.184377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:43.185141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:43.185563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:43.193656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:43.194258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:43.200339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:43.200777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:43.201641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:43.202074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:43.269053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:43.284460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-534c0b76-761a-4cae-98ef-f689b0b4b28f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1462 microversion: 2.1 time: 0.094555 Jul 25 19:07:43.286126 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 263/538] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:43 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:43.332853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:43.340941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7ed6e088-b47e-454d-97cf-87b77c953a6a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.168658 Jul 25 19:07:43.341517 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 276/539] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:43 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:44.307061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:44.307709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:44.315285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:44.316176 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:44.317118 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:44.318569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:44.339727 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:44.362462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:44.363074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:44.369627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:44.370071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:44.371862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:44.371862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:44.389697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:44.398408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-67f3b112-e660-40b2-8d31-52c1106cb878 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1462 microversion: 2.1 time: 0.095239 Jul 25 19:07:44.398995 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 264/540] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:44 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:44.541640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:44.550559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c1e79205-ba89-4447-a6ac-4b43bf52e36d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.192627 Jul 25 19:07:44.551785 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 277/541] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:44 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:44.846001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:07:44.846206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:07:45.421964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:45.422548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:45.428602 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:45.429051 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:45.429817 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:45.430252 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:45.492451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:45.500897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4edb165a-2992-43ff-b157-5105b4060923 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1299 microversion: 2.1 time: 0.082920 Jul 25 19:07:45.501363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 265/542] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:45 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:45.572428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:45.573038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:45.580987 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:45.581438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:45.582298 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:45.582763 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:45.731029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:45.739201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-05e443c1-84a3-41dc-b2b7-a1f8f97c00ee tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.170605 Jul 25 19:07:45.739748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 278/543] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:45 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:46.522479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:46.523084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:46.529235 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:46.529668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:46.530490 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:46.530914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:46.596528 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:46.604195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d0b2e204-2306-4d02-a5bd-ffc1c6eb1a8c tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1299 microversion: 2.1 time: 0.085672 Jul 25 19:07:46.604764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 266/544] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:46 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:46.760962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:46.761575 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:46.769438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:46.769884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:46.770698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:46.771137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:46.943470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:46.950988 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-57c4bb47-f5b0-4399-a61f-1fef695f8e53 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.195115 Jul 25 19:07:46.951587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 279/545] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:46 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:47.627161 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:47.627986 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:47.634278 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:47.634749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:47.635546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:47.635970 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:47.669359 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:47.669792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:47.670229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lazy-loading 'fault' on Instance uuid 2eb463f9-92ba-4071-9aa5-a1bdccc80710 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:07:47.712076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:47.720031 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6f6b555a-abb4-4788-8be9-caa19654c4c0 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1304 microversion: 2.1 time: 0.097611 Jul 25 19:07:47.720602 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 267/546] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:47 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:47.973404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:47.974020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:47.981553 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:47.982021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:47.982835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:47.983273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:48.140444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:48.148144 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7412f33f-3ec9-418c-a31f-e8b28e6462cc tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.178596 Jul 25 19:07:48.148887 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 280/547] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:47 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:48.741559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:48.742167 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:48.744173 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:48.749521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:48.749967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:48.751527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:48.751957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:48.786454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:48.786835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:48.787283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lazy-loading 'fault' on Instance uuid 2eb463f9-92ba-4071-9aa5-a1bdccc80710 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:07:48.830468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:48.838171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a173acc8-7a7d-42fd-ab1b-0ca51c23cb01 tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1304 microversion: 2.1 time: 0.100529 Jul 25 19:07:48.838788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 268/548] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:48 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:49.182732 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:49.183369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:49.190646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:49.191223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:49.192097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:49.192600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:49.345417 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:49.353363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6ddfe008-9893-4ca6-9c2c-6f85908b5da0 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1319 microversion: 2.1 time: 0.174349 Jul 25 19:07:49.353929 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 281/549] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:49 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:49.860532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:49.861351 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:49.868866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:49.872326 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:49.872326 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:49.872326 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:49.923468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:49.923919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:49.929648 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lazy-loading 'fault' on Instance uuid 2eb463f9-92ba-4071-9aa5-a1bdccc80710 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:07:49.968647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d04f1378edc435a801a6c2719ec31f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9062c0ee33bb464c88d5f5e7471c6961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:49.980732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a891cd66-9ca3-49c7-9959-5310ce7d873a tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 200 len: 1304 microversion: 2.1 time: 0.124642 Jul 25 19:07:49.981316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 269/550] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:49 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:50.056699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9d257a3b-62ea-4bf9-8e2b-5a47b48b5931 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'create', calling method: .version_select at 0x7fd8e5cebaf0>, body: {"keypair": {"name": "tempest-keypair-2111031312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc6bSTx/deM6RPQ+16GHN6YqUN2XEnR0hNasz+zSWD6tvCJTFMP4t8ceO02DRnkwxr2EL9YywfpYkbUdTFIwrs5QV2Tr9jU3S3wXPoXvLLEiqNEQAzRYH1M7eikLnNYhQ=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:50.072478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-9d257a3b-62ea-4bf9-8e2b-5a47b48b5931 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:07:50.076558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-9d257a3b-62ea-4bf9-8e2b-5a47b48b5931 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for user 7e3f168283ba4f159948830f396ae7cf and project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:07:50.181076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9d257a3b-62ea-4bf9-8e2b-5a47b48b5931 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128126 Jul 25 19:07:50.181729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 282/551] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:07:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:07:50.377432 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:50.378153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:50.384856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:50.385303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:50.386076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:50.386574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:50.547644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:50.556567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8c6dd46c-a35b-47fc-8913-0b2794893dd8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1507 microversion: 2.1 time: 0.184655 Jul 25 19:07:50.557296 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 270/552] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:50 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:51.007688 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:51.008296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] [instance: 2eb463f9-92ba-4071-9aa5-a1bdccc80710] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:51.015086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:51.015652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:51.016604 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:51.017134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:51.032031 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] HTTP exception thrown: Instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 could not be found. Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Request method failure captured: Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 HTTP/1.1 Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3umCFXwOx8_SHZOhXfGWcviJ3353vFVHK3ABBh7bFni69PDxMK-JFkIFFrRJFxDZrH_HTadwx5aBx0GK2RgMUdv1sQvPU0VFz5PxhM8pK3Cd35PJk6TqjRDaZ-wA1E7Tofd-4hvMWUYQHjNBs8MyjrEaELpLNflOvikH0pydTLMsxxA Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 9062c0ee33bb464c88d5f5e7471c6961 Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesActionsTest-3854712 Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:07:51.033691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9062c0ee33bb464c88d5f5e7471c6961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9062c0ee33bb464c88d5f5e7471c6961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9062c0ee33bb464c88d5f5e7471c6961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9062c0ee33bb464c88d5f5e7471c6961", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesActionsTest-3854712 Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 9062c0ee33bb464c88d5f5e7471c6961 Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesActionsTest-3854712 Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesActionsTest-3854712-project Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 8d04f1378edc435a801a6c2719ec31f5 Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesActionsTest-3854712-project Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 could not be found. Jul 25 19:07:51.036284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '2eb463f9-92ba-4071-9aa5-a1bdccc80710'} Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 could not be found. Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:07:51.037885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 could not be found. Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 could not be found. Jul 25 19:07:51.040450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:07:51.042710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] Returning 404 to user: Instance 2eb463f9-92ba-4071-9aa5-a1bdccc80710 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:07:51.042710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0f0044b4-52b0-4321-9a50-8e06fece266f tempest-VolumesActionsTest-3854712 tempest-VolumesActionsTest-3854712-project] 10.222.0.17 "GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710" status: 404 len: 111 microversion: 2.1 time: 0.032150 Jul 25 19:07:51.042710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 283/553] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:51 2022] GET /compute/v2.1/servers/2eb463f9-92ba-4071-9aa5-a1bdccc80710 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:07:53.397179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-823568264", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9229fc30-046e-4028-a03d-cbb3123aa86d"}], "security_groups": [{"name": "tempest-securitygroup--1084703941"}], "key_name": "tempest-keypair-2111031312", "user_data": "}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:07:53.553179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] validate_networks() for [('9229fc30-046e-4028-a03d-cbb3123aa86d', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:07:54.201612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:07:54.203573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:07:54.204106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:07:54.204604 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:07:54.205042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:07:54.216120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:54.216557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:54.217347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:54.218313 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:54.240501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:07:54.246101 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Getting quotas for user 7e3f168283ba4f159948830f396ae7cf and project 08c6be8edb884214bae7a0abbf97dc16. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:07:54.259175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:07:54.261446 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:07:54.391248 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b07b1d47-a956-49e4-aa4f-b0adeb1b572d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.999526 Jul 25 19:07:54.392173 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 271/554] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:07:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:07:54.404310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c3024d2c-81f4-4152-a1e8-7241626ddc3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:54.405676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c3024d2c-81f4-4152-a1e8-7241626ddc3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:54.482461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c3024d2c-81f4-4152-a1e8-7241626ddc3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:54.490676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c3024d2c-81f4-4152-a1e8-7241626ddc3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1245 microversion: 2.1 time: 0.090464 Jul 25 19:07:54.491279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 284/555] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:54 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:55.513324 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:55.514262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:55.521461 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:55.524005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:55.524005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:55.524005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:55.602611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:55.613518 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-eda0aca8-6c10-4fbd-80dd-55f197cdb0ee tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1249 microversion: 2.1 time: 0.104148 Jul 25 19:07:55.614195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 272/556] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:55 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1249 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:56.653921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:56.660206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:56.662667 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:56.663124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:56.663896 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:56.664332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:56.733782 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:56.747396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-56e34878-5236-4bc4-9d44-35581b6384e5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1249 microversion: 2.1 time: 0.097011 Jul 25 19:07:56.748503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 285/557] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:56 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:07:57.780738 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:57.781653 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:57.788352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:57.792035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:57.792035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:57.792035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:57.856120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:57.864214 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f80ee744-b0dc-4780-b292-6127a3d549c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1249 microversion: 2.1 time: 0.088041 Jul 25 19:07:57.865086 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 273/558] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:57 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:58.886588 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:07:58.887318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:07:58.890424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:58.895997 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:58.896792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:58.898156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:07:58.898711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:07:58.966838 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:07:58.975248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3088d19d-8d32-4f23-afd8-fdb3729b1f5d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1241 microversion: 2.1 time: 0.092636 Jul 25 19:07:58.975820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 286/559] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:58 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:00.000502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:00.008148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:00.010093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:00.010651 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:00.011681 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:00.012127 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:00.084593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:00.093203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7b92ddf2-650c-43ee-b5fe-27cdfa638f8c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1241 microversion: 2.1 time: 0.098360 Jul 25 19:08:00.094010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 274/560] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:07:59 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:08:01.115329 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:01.116009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:01.122626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:01.123072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:01.124431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:01.125061 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:01.147766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:01.197030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:01.205558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-98c88ed7-bea8-4cff-b679-d4cdbd753af6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1305 microversion: 2.1 time: 0.093979 Jul 25 19:08:01.206224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 287/561] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:01 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:02.234310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:02.235022 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:02.245057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:02.245815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:02.247200 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:02.247810 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:02.429525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:02.438696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c13e7aae-be5e-4dd0-ab6a-f72da1d5d833 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.212395 Jul 25 19:08:02.443755 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 275/562] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:02 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:03.169996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-8b883063-4739-4491-b6b6-7cb1dd7dde46 req-6e300985-698f-40ec-8cfe-709c9efeb28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047c609b-8920-48da-a883-8ecb7c6214e9", "tag": "2e704b22-3b93-4105-9a08-ff7d4aa61557"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:08:03.200407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8b883063-4739-4491-b6b6-7cb1dd7dde46 req-6e300985-698f-40ec-8cfe-709c9efeb28d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:03.201589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8b883063-4739-4491-b6b6-7cb1dd7dde46 req-6e300985-698f-40ec-8cfe-709c9efeb28d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:03.216181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-8b883063-4739-4491-b6b6-7cb1dd7dde46 req-6e300985-698f-40ec-8cfe-709c9efeb28d service nova] Creating event network-changed:2e704b22-3b93-4105-9a08-ff7d4aa61557 for instance 047c609b-8920-48da-a883-8ecb7c6214e9 on hv-cinder-82002 Jul 25 19:08:03.223265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-8b883063-4739-4491-b6b6-7cb1dd7dde46 req-6e300985-698f-40ec-8cfe-709c9efeb28d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058726 Jul 25 19:08:03.223880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 288/563] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:08:03.460289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:03.461050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:03.467826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:03.468280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:03.469053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:03.469490 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:03.626272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:03.638621 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-96136c2d-ec53-43ea-b57f-ea0cf6285cc5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.181970 Jul 25 19:08:03.640004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 276/564] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:03 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:04.661936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:04.663431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:04.665973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:04.672529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:04.672978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:04.673799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:04.674240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:04.815086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:04.823615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b16dc225-e43e-47ff-8d60-44af26bc1f6a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.165925 Jul 25 19:08:04.824189 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 289/565] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:04 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:05.845775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:05.846393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:05.848223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:05.848925 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:05.853739 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:05.854180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:05.854966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:05.855396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:05.993975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:06.002234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5562a2e3-a9b7-454c-9dab-9f4997b8c0ad tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.161062 Jul 25 19:08:06.002826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 277/566] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:05 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:07.024741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:07.025356 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:07.035345 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:07.035841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:07.036724 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:07.037163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:07.188111 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:07.196445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-354853c8-2448-45e9-9783-f9a8b39a12c7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.175894 Jul 25 19:08:07.197016 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 290/567] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:07 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:08.220219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:08.221425 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:08.229873 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:08.230357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:08.231162 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:08.231777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:08.378254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:08.393445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-cdfbbbe4-aa49-4ff9-98fc-d8a1b53bfc17 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.177019 Jul 25 19:08:08.394049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 278/568] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:08 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:09.416853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:09.417407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:09.424839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:09.425366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:09.426064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:09.426531 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:09.590149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:09.598087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2746bd93-35e2-43d3-9ee6-dc054f5c6a57 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.186157 Jul 25 19:08:09.598695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 291/569] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:09 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:10.621125 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:10.621893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:10.631079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:10.631522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:10.634275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:10.634737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:10.790995 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:10.798569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a8e2fc90-79e2-43c9-8674-0523636ed4b0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.181199 Jul 25 19:08:10.799204 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 279/570] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:10 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:11.820018 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:11.820630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:11.828409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:11.828900 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:11.829797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:11.830238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:11.972769 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:11.980396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e6abc3e9-6236-428d-bfc9-10fce0a89b4c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.164365 Jul 25 19:08:11.980969 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 292/571] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:11 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:13.005018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:13.005946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:13.013308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:13.013767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:13.016517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:13.018123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:13.167049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:13.169261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:13.176501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-421600e4-e962-4d9d-ac31-6b02de4eab72 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.176239 Jul 25 19:08:13.182165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 280/572] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:12 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:14.197423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:14.197950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:14.204705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:14.205147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:14.205921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:14.206382 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:14.341775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:14.351558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5b4a11f5-fa02-422e-87ac-65091f130f0c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.158122 Jul 25 19:08:14.352125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 293/573] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:14 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:15.374469 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:15.375311 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:15.382024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:15.382524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:15.383297 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:15.383732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:15.519924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:15.527620 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-62936103-82f4-452a-a13c-fc2da9fe913d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.158200 Jul 25 19:08:15.528180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 281/574] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:15 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:16.550847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:16.551503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:16.560379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:16.561188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:16.563311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:16.564095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:16.726515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:16.733990 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a0d3185d-c5cb-46c0-839c-35936de22aba tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.187939 Jul 25 19:08:16.734579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 294/575] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:16 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:17.756346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:17.757006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:17.763508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:17.763965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:17.765073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:17.765510 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:17.963418 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:17.983023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6b16f08b-c927-4e74-a4c0-4cb2e976905b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.227482 Jul 25 19:08:17.983023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 282/576] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:17 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:19.016421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:19.017849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:19.031162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:19.032409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:19.033317 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:19.034054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:19.214647 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:19.224673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cb6cfb53-0feb-4e07-a38b-98116976cced tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.213950 Jul 25 19:08:19.225946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 295/577] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:19 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:20.255043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:20.257472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:20.262732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:20.270636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:20.272561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:20.273388 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:20.274607 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:20.500034 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:20.512011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ebb09412-b5e4-4cd2-acc5-6989b5343474 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.266229 Jul 25 19:08:20.513283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 283/578] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:20 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:08:21.547461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:21.548238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:21.559708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:21.563043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:21.564095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:21.564893 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:21.750807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:21.764805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-21255e16-b991-43a7-8915-39775f367ac9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.221436 Jul 25 19:08:21.766401 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 296/579] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:21 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:22.792180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:22.793730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:22.801500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:22.802317 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:22.804115 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:22.804814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:22.991004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:23.002665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e47e7821-7c12-4bdc-96dd-1dd1fde70272 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.214082 Jul 25 19:08:23.003548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 284/580] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:22 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:24.037755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:24.040416 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:24.048045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:24.048737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:24.049711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:24.050148 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:24.224519 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:24.237442 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a5a7cf62-3544-4eb9-9c40-4c33918c5a15 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.203483 Jul 25 19:08:24.238312 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 297/581] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:24 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:25.267982 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:25.268863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:25.277778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:25.278344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:25.279223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:25.280322 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:25.443798 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:25.453686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2a7af434-8be2-45bb-810e-e6cb58ae3c86 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.190274 Jul 25 19:08:25.454569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 285/582] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:25 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:08:26.490067 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:26.491028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:26.502745 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:26.506930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:26.508106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:26.512434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:26.677889 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:26.686955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-093b653b-2704-4c14-9f66-e30940d704be tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.213511 Jul 25 19:08:26.687579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 298/583] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:26 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:27.708340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:27.708958 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:27.715313 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:27.715758 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:27.723950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:27.723950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:27.855180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:27.865432 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2e859d80-6e71-428f-a5af-10253e2538d4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.161085 Jul 25 19:08:27.866301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 286/584] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:27 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:28.893101 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:28.896474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:28.903700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:28.904387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:28.906222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:28.907010 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:29.064336 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:29.077713 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-22601baf-52a5-4fab-8bfa-a0da88acbb0f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.188319 Jul 25 19:08:29.079159 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 299/585] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:28 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:30.099317 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:30.099953 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:30.106545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:30.106983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:30.107773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:30.108285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:30.252557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:30.260330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8c957fc8-a12e-453a-af17-a8f3e3c36630 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.165082 Jul 25 19:08:30.260898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 287/586] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:30 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:31.282559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:31.283234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:31.285630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=28 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:31.290614 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:31.298097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:31.298097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:31.298097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:31.298466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=71 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:31.475172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:31.485961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9db198b2-9a78-4ba1-970f-12211cb1f478 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.208491 Jul 25 19:08:31.499715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 300/587] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:31 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:32.513625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:32.517221 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:32.527168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:32.528053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:32.531247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:32.532226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:32.762669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:32.788194 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5ca6569f-30e9-42a2-b51b-f8dd31130211 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.280594 Jul 25 19:08:32.789809 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 288/588] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:32 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:33.815935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:33.816601 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:33.823576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:33.824083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:33.824810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:33.825249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:33.965758 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:33.974008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-48aac869-5e3d-4a1d-a0c1-4bc8ae0b0ee7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.162033 Jul 25 19:08:33.974618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 301/589] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:33 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:34.995451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:34.996262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:35.003580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:35.004075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:35.004796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:35.005491 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:35.170587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:35.178503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5dc0fff4-80fb-43c0-a913-51567e6c3294 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.187074 Jul 25 19:08:35.179073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 289/590] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:34 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:36.202099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:36.202711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:36.209910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:36.210378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:36.211148 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:36.211608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:36.346824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:36.354271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e70160e0-8615-4632-bc72-b1a4a86c3789 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.156155 Jul 25 19:08:36.354855 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 302/591] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:36 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:37.375246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:37.376442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:37.382546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:37.382993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:37.383757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:37.384186 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:37.530369 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:37.539371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2f5fa659-0ef9-40f6-a141-d67faa93d2d8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.168151 Jul 25 19:08:37.539952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 290/592] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:37 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:38.562267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:38.562907 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:38.570271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:38.570736 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:38.571495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:38.571920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:38.704547 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:38.711938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-139af4bb-f7c9-4052-ae2c-8a8db8abda02 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.153520 Jul 25 19:08:38.712506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 303/593] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:38 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:39.733642 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:39.734568 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:39.741986 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:39.742623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:39.743614 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:39.744043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:39.947234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:39.957530 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-59c88802-b81b-4c0d-84e0-0430d9480c3e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.228153 Jul 25 19:08:39.958378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 291/594] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:39 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:40.979938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:40.980571 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:40.988933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:40.989391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:40.990421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:40.991028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:41.149116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:41.159851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a7ecee85-0ce9-4762-ab41-24a9f7be38ae tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.183800 Jul 25 19:08:41.161464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 304/595] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:40 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:41.878123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-ae995213-0d5f-4e5e-b707-10d17619b93d req-71f15edb-7467-4a3c-8b75-1b318c729acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047c609b-8920-48da-a883-8ecb7c6214e9", "name": "network-vif-plugged", "status": "completed", "tag": "2e704b22-3b93-4105-9a08-ff7d4aa61557"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:08:41.889044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-ae995213-0d5f-4e5e-b707-10d17619b93d req-71f15edb-7467-4a3c-8b75-1b318c729acc service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:41.889357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-ae995213-0d5f-4e5e-b707-10d17619b93d req-71f15edb-7467-4a3c-8b75-1b318c729acc service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:41.902019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-ae995213-0d5f-4e5e-b707-10d17619b93d req-71f15edb-7467-4a3c-8b75-1b318c729acc service nova] Creating event network-vif-plugged:2e704b22-3b93-4105-9a08-ff7d4aa61557 for instance 047c609b-8920-48da-a883-8ecb7c6214e9 on hv-cinder-82002 Jul 25 19:08:41.908758 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-ae995213-0d5f-4e5e-b707-10d17619b93d req-71f15edb-7467-4a3c-8b75-1b318c729acc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034915 Jul 25 19:08:41.915735 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 292/596] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:08:42.181408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:42.182021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:42.189755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:42.190204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:42.191020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:42.191453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:42.333373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:42.340804 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7b1e0aef-e647-4289-a3b0-dca1574cf02e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.163311 Jul 25 19:08:42.341396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 305/597] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:42 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:43.363270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:43.363959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:43.370053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:43.370559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:43.371309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:43.371733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:43.514841 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:43.522379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8eb03f9f-8d31-4c8a-8205-ac0d3ffed9ca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.163560 Jul 25 19:08:43.523119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 293/598] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:43 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:44.543643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:44.544461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:44.551941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:44.552417 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:44.553216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:44.553645 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:44.709894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:44.709894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f0aafdfc-2440-4569-89f3-0c78db3a77c3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.170097 Jul 25 19:08:44.710805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 306/599] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:44 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:45.732586 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:45.733205 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:45.739533 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:45.740014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:45.740780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:45.741208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:45.744023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=76 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:45.878093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:45.885915 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b0e1e727-d0b6-4391-8f3a-a94a779b2493 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1371 microversion: 2.1 time: 0.157174 Jul 25 19:08:45.886493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 294/600] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:45 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:46.908679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:46.909243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:46.915741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:46.916179 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:46.916951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:46.917380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:47.060508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:08:47.068576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5b846d48-a000-4ea6-a261-de9ccc1fcda4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1565 microversion: 2.1 time: 0.164876 Jul 25 19:08:47.069146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 307/601] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:08:46 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:08:47.089425 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:08:47.089966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:47.096608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:47.097049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:47.097806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:47.098232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:47.181933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7333b1fd-0ec3-4793-9e24-f80e25878e3c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096371 Jul 25 19:08:47.182685 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 295/602] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:08:47 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:08:48.653972 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-0bcec74a-d7b1-42ea-aa6e-58cd0a101fcb req-806094d9-976a-4b23-8a41-fbbe7cfb3734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047c609b-8920-48da-a883-8ecb7c6214e9", "tag": "2e704b22-3b93-4105-9a08-ff7d4aa61557"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:08:48.665258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-0bcec74a-d7b1-42ea-aa6e-58cd0a101fcb req-806094d9-976a-4b23-8a41-fbbe7cfb3734 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:48.665711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-0bcec74a-d7b1-42ea-aa6e-58cd0a101fcb req-806094d9-976a-4b23-8a41-fbbe7cfb3734 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:48.678079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-0bcec74a-d7b1-42ea-aa6e-58cd0a101fcb req-806094d9-976a-4b23-8a41-fbbe7cfb3734 service nova] Creating event network-changed:2e704b22-3b93-4105-9a08-ff7d4aa61557 for instance 047c609b-8920-48da-a883-8ecb7c6214e9 on hv-cinder-82002 Jul 25 19:08:48.683310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-0bcec74a-d7b1-42ea-aa6e-58cd0a101fcb req-806094d9-976a-4b23-8a41-fbbe7cfb3734 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033098 Jul 25 19:08:48.683915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 308/603] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:08:59.869078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=25 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.869942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=9 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.874431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd3cf974-8654-41ad-8a79-f524b01a2195", "device": "/dev/sdb"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:08:59.878148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:08:59.886417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:59.887142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:08:59.887991 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:08:59.888484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:09:01.010207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-974fa919-dc77-4a43-a41f-9b31ddfedb27 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "POST /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129699 Jul 25 19:09:01.010207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 296/604] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:08:59 2022] POST /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70/os-volume_attachments => generated 194 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:09:19.549340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=17 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:19.552273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=49 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:19.558373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:09:19.561426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:09:19.576416 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:09:19.578355 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:09:19.579119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:09:19.579337 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:09:24.840881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7c05682e-f162-4d3e-8b72-3c52d7fd1de1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/action" status: 200 len: 28625 microversion: 2.20 time: 5.293164 Jul 25 19:09:24.841572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 309/605] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Jul 25 19:09:19 2022] POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/action => generated 28625 bytes in 5295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:09:29.799096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:29.799863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:29.993329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:09:29.996085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:09:30.005563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:09:30.006007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:09:30.006814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:09:30.007250 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:09:30.134762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-53e7e2c7-b09c-4585-b078-ddbef7300f41 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action" status: 200 len: 28667 microversion: 2.1 time: 0.341433 Jul 25 19:09:30.135632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 297/606] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:09:29 2022] POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action => generated 28667 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:09:36.061834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:09:36.062721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:10:12.166751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:12.167695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:12.170161 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:12.170852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=4 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:12.178430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:12.178879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:12.179684 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:12.180119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:12.501805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lazy-loading 'services' on Instance uuid 817e855e-4d22-4477-ac1a-c8e368f8cb70 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:10:12.831907 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-95656940-f16a-4458-b1a2-0365d5882623 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70/os-volume_attachments/cd3cf974-8654-41ad-8a79-f524b01a2195" status: 202 len: 0 microversion: 2.1 time: 0.656418 Jul 25 19:10:12.831907 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 310/607] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:10:12 2022] DELETE /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70/os-volume_attachments/cd3cf974-8654-41ad-8a79-f524b01a2195 => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:10:24.589608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:24.590796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:24.592730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:24.594659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=4 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:24.599195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:24.600158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:24.601076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:24.601595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:24.630902 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:10:25.125639 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2376948a-12f6-4981-be0c-2cc1274bba1a tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 204 len: 0 microversion: 2.1 time: 0.540443 Jul 25 19:10:25.128138 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 298/608] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:10:24 2022] DELETE /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:10:25.136018 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:25.137327 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:25.139841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:25.140631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:25.145783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:25.146266 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:25.147070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:25.148178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:25.289589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:25.297204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ba4ffc32-8fa0-4975-9eeb-13f529e32ef8 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1513 microversion: 2.1 time: 0.165955 Jul 25 19:10:25.297765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 311/609] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:25 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:26.319584 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:26.320217 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:26.327857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:26.329398 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:26.329398 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:26.329594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:26.626752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:26.636901 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-18bbe085-981d-473d-bcb8-82c659669fc3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1513 microversion: 2.1 time: 0.322435 Jul 25 19:10:26.637566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 299/610] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:26 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:27.662635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:27.663689 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:27.674428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:27.674911 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:27.675680 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:27.676110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:27.813095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:27.821266 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b52fdb0d-fb6f-4223-b344-5a32b257392c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1513 microversion: 2.1 time: 0.165072 Jul 25 19:10:27.828447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 312/611] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:27 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:10:28.782073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-2deeb19e-11bb-44b0-8e9f-438e142b8a9e req-bc79d3bb-8f0a-49a0-b8c5-fb04d5ef56ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817e855e-4d22-4477-ac1a-c8e368f8cb70", "name": "network-vif-deleted", "tag": "966af95a-bc29-41c4-a594-5ac6825a7c2f"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:10:28.791443 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-2deeb19e-11bb-44b0-8e9f-438e142b8a9e req-bc79d3bb-8f0a-49a0-b8c5-fb04d5ef56ff service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:28.791907 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-2deeb19e-11bb-44b0-8e9f-438e142b8a9e req-bc79d3bb-8f0a-49a0-b8c5-fb04d5ef56ff service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:28.803679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-2deeb19e-11bb-44b0-8e9f-438e142b8a9e req-bc79d3bb-8f0a-49a0-b8c5-fb04d5ef56ff service nova] Creating event network-vif-deleted:966af95a-bc29-41c4-a594-5ac6825a7c2f for instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 on hv-cinder-82002 Jul 25 19:10:28.809451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-2deeb19e-11bb-44b0-8e9f-438e142b8a9e req-bc79d3bb-8f0a-49a0-b8c5-fb04d5ef56ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094462 Jul 25 19:10:28.810046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 300/612] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:10:28.845892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:28.846541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:28.853938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:28.854412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:28.855182 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:28.855608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:28.920335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:28.928523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-17716e82-a72a-4a7f-830e-c8e7b968fb4f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1471 microversion: 2.1 time: 0.086463 Jul 25 19:10:28.936465 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 313/613] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:28 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:29.952408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:29.953194 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:29.959371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:29.959805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:29.960565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:29.961623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:29.993689 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:29.994133 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:29.994668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lazy-loading 'fault' on Instance uuid 817e855e-4d22-4477-ac1a-c8e368f8cb70 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:10:30.044423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:30.052634 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d472c379-b615-4d96-929d-6bf1439b4d04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 200 len: 1309 microversion: 2.1 time: 0.104774 Jul 25 19:10:30.053485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 301/614] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:29 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:31.086208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:31.086936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 817e855e-4d22-4477-ac1a-c8e368f8cb70] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:31.097435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:31.097435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:31.097435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:31.097435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:31.109258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] HTTP exception thrown: Instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 could not be found. Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Request method failure captured: Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 HTTP/1.1 Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3unBeDjrbkKF8zgfZnsJRT-nyaR3iK2HGq6OdMdljWKxAexYVafJI04DWArfrsOdHs5-Nt2vA8tOy9rXVIsfNxoM_icBYBtmBE4Z4HJLWhKS_pjoERnKOfsOVadrnIpmnshHiBdLo6gt7CCdgzAsv99LmT9nH6uggLlwNOYFKecWhTE Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 387ac04100224395a581aa382deb19b0 Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1708046868 Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:10:31.110946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/387ac04100224395a581aa382deb19b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/387ac04100224395a581aa382deb19b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/387ac04100224395a581aa382deb19b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_387ac04100224395a581aa382deb19b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesSnapshotTestJSON-1708046868 Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 387ac04100224395a581aa382deb19b0 Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1708046868 Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesSnapshotTestJSON-1708046868-project Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 5321524c39c14135b5cc77e21598cbe1 Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesSnapshotTestJSON-1708046868-project Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 could not be found. Jul 25 19:10:31.112856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '817e855e-4d22-4477-ac1a-c8e368f8cb70'} Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 could not be found. Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:10:31.113848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 could not be found. Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 could not be found. Jul 25 19:10:31.115351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:10:31.118351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Returning 404 to user: Instance 817e855e-4d22-4477-ac1a-c8e368f8cb70 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:10:31.118351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d8b04c8b-53d8-44ae-bcc0-fd5c5f54a293 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70" status: 404 len: 111 microversion: 2.1 time: 0.030347 Jul 25 19:10:31.118351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 314/615] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:31 2022] GET /compute/v2.1/servers/817e855e-4d22-4477-ac1a-c8e368f8cb70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:10:51.337038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-389879932", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "networks": [{"uuid": "6a578d58-7b25-445c-860f-38e792f6130d"}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:10:51.346449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:51.347096 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:51.398445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] validate_networks() for [('6a578d58-7b25-445c-860f-38e792f6130d', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:10:51.879278 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:10:51.879689 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:10:51.880151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:10:51.880577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:10:51.880979 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:10:51.891203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:51.891654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:51.893137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:51.893137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:51.917251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Getting quotas for project 387ac04100224395a581aa382deb19b0. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:10:51.918281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Getting quotas for user 5321524c39c14135b5cc77e21598cbe1 and project 387ac04100224395a581aa382deb19b0. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:10:51.931555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:10:51.934174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:10:52.173100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:10:53.184753 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 33904. Jul 25 19:10:53.189722 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7386ecdc-cc7b-4dac-b767-79888d2ebd30 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.856565 Jul 25 19:10:53.190511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 302/616] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:10:53.202933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5212b24f-746b-4d99-8cdc-981ea55cbd6c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:53.203756 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5212b24f-746b-4d99-8cdc-981ea55cbd6c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:53.207297 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=8 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:53.208988 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=20 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:53.271707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5212b24f-746b-4d99-8cdc-981ea55cbd6c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:53.279646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5212b24f-746b-4d99-8cdc-981ea55cbd6c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1218 microversion: 2.1 time: 0.081596 Jul 25 19:10:53.280221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 315/617] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:53 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:54.305718 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4d5d08c0-582c-4a14-95a6-e446371faa0e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:54.306564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4d5d08c0-582c-4a14-95a6-e446371faa0e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:54.363489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4d5d08c0-582c-4a14-95a6-e446371faa0e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:54.371679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4d5d08c0-582c-4a14-95a6-e446371faa0e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1218 microversion: 2.1 time: 0.071250 Jul 25 19:10:54.372253 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 303/618] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:54 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:55.396253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:55.397085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:55.406135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:55.406951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:55.407820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:55.408639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:55.483368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:55.496205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c6af9346-55d9-480a-915c-ac554fd14d36 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1270 microversion: 2.1 time: 0.105991 Jul 25 19:10:55.497168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 316/619] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:55 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:56.542730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:56.543427 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:56.550525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:56.555870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:56.555870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:56.555870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:56.622237 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:56.630279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-12d8bf32-5b9f-4e81-a868-a4827b4f5d97 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1276 microversion: 2.1 time: 0.092906 Jul 25 19:10:56.630886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 304/620] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:56 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:57.654064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:57.655499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:57.663128 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:57.663550 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:57.664550 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:57.664847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:57.874673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:57.884143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9b0d47d6-7274-4914-a031-e82883e4c56e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.234879 Jul 25 19:10:57.884812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 317/621] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:57 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:10:58.099593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-0ecce749-a7f9-476c-b2f2-6e9a809d5451 req-59ecf173-315f-4c54-923d-e9310ed8fd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705fce8e-42d6-4006-90cb-feb4eff8c388", "tag": "4ae7a041-6149-45ea-9d92-dd492aac3de2"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:10:58.110878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-0ecce749-a7f9-476c-b2f2-6e9a809d5451 req-59ecf173-315f-4c54-923d-e9310ed8fd20 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:58.111321 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-0ecce749-a7f9-476c-b2f2-6e9a809d5451 req-59ecf173-315f-4c54-923d-e9310ed8fd20 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:58.124919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-0ecce749-a7f9-476c-b2f2-6e9a809d5451 req-59ecf173-315f-4c54-923d-e9310ed8fd20 service nova] Creating event network-changed:4ae7a041-6149-45ea-9d92-dd492aac3de2 for instance 705fce8e-42d6-4006-90cb-feb4eff8c388 on hv-cinder-82002 Jul 25 19:10:58.130119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-0ecce749-a7f9-476c-b2f2-6e9a809d5451 req-59ecf173-315f-4c54-923d-e9310ed8fd20 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036958 Jul 25 19:10:58.130808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 305/622] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:10:58.908522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:10:58.908522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:10:58.916461 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:58.916917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:58.917804 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:10:58.918453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:10:59.132589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:10:59.143365 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-197b30c8-c218-4d88-be56-461f23feafc4 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.239949 Jul 25 19:10:59.144752 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 318/623] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:10:58 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:00.167873 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:00.168560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:00.174944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:00.175386 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:00.176135 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:00.176560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:00.314256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:00.322144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-94e35024-8170-4279-908c-efb5767412c1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.159400 Jul 25 19:11:00.322779 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 306/624] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:00 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:01.343346 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:01.344157 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:01.350911 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:01.351571 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:01.353165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:01.353689 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:01.489162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:01.497446 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-922331b2-849c-4e8b-9c0a-d4b4033c3ca3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.158016 Jul 25 19:11:01.498009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 319/625] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:01 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:02.519487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:02.520158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:02.522797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:02.528349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:02.533249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:02.533249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:02.533249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:02.671628 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:02.679156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6366e99f-32b5-47d5-8636-af21d6022002 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.164155 Jul 25 19:11:02.679720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 307/626] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:02 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:03.703186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:03.703851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:03.706316 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:03.711951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:03.712532 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:03.716568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:03.716568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:03.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:03.862503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-af0d65bd-bfcb-49ff-825f-b05e0f3ae9c5 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.163740 Jul 25 19:11:03.863071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 320/627] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:03 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:04.854554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:11:04.855232 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:11:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:11:04.884409 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:04.886878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:04.890021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=8 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:04.895375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:04.895829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:04.897094 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:04.897856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:05.050764 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:05.058537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-92dcc5dc-c905-4324-beb4-4e697ee51e0c tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.178509 Jul 25 19:11:05.059112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 308/628] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:04 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:06.080783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:06.081370 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:06.088848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:06.089217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:06.089987 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:06.090447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:06.225265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:06.233548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b0137714-e127-4b68-9d99-87d50574c638 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.156616 Jul 25 19:11:06.237358 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 321/629] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:06 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:07.254413 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:07.270468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:07.270468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:07.270468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:07.270468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:07.270898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:07.395816 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:07.409530 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-04565b38-de76-4205-8e4d-cfd47461af04 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.153748 Jul 25 19:11:07.409530 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 309/630] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:07 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:08.425598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:08.426137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:08.433847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:08.434307 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:08.435119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:08.435557 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:08.569711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:08.577813 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3e5c0ce9-573b-4958-b4fb-d4b71a91a8f3 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.156240 Jul 25 19:11:08.578426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 322/631] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:08 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:09.242721 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-402149ad-4fc1-4008-a005-81f025672b70 req-dea20884-08b1-47cd-bf8c-e8d0b93f98dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705fce8e-42d6-4006-90cb-feb4eff8c388", "name": "network-vif-plugged", "status": "completed", "tag": "4ae7a041-6149-45ea-9d92-dd492aac3de2"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:11:09.252627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-402149ad-4fc1-4008-a005-81f025672b70 req-dea20884-08b1-47cd-bf8c-e8d0b93f98dc service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:09.253060 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-402149ad-4fc1-4008-a005-81f025672b70 req-dea20884-08b1-47cd-bf8c-e8d0b93f98dc service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:09.265509 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-402149ad-4fc1-4008-a005-81f025672b70 req-dea20884-08b1-47cd-bf8c-e8d0b93f98dc service nova] Creating event network-vif-plugged:4ae7a041-6149-45ea-9d92-dd492aac3de2 for instance 705fce8e-42d6-4006-90cb-feb4eff8c388 on hv-cinder-82002 Jul 25 19:11:09.270893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-402149ad-4fc1-4008-a005-81f025672b70 req-dea20884-08b1-47cd-bf8c-e8d0b93f98dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231242 Jul 25 19:11:09.271494 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 310/632] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:11:09.598668 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:09.599874 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:09.606802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:09.607247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:09.608013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:09.608450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:09.745195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:09.753207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7f6ab99b-23da-4436-9aff-270faf3275d9 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.158329 Jul 25 19:11:09.753770 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 323/633] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:09 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:10.775863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:10.776799 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:10.783371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:10.787075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:10.787075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:10.787075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:10.926273 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:10.934960 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ea32ad75-2c34-4fc9-82b8-0d650c7cf103 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.164549 Jul 25 19:11:10.935547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 311/634] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:10 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:11.956525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:11.957245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:11.971106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:11.971106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:11.971106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:11.971106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:12.118964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:12.126998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-823c05b1-1b88-42d6-9477-cbb7f152406e tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1318 microversion: 2.1 time: 0.174050 Jul 25 19:11:12.127562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 324/635] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:11 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:13.148537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:13.149187 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:13.155780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:13.156229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:13.156999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:13.157434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:13.287973 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:13.296459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bc5ba5f7-40e7-40b5-948b-ac259c9aa393 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1506 microversion: 2.1 time: 0.151755 Jul 25 19:11:13.297033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 312/636] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:13 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:13.318086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e48cde9-1fe3-4cb8-a28c-45a07190670e", "device": "/dev/sdb"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:11:13.321008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:13.327586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:13.328024 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:13.328834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:13.329257 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:14.423552 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-82629db8-c3ec-41be-875a-360b417c99cf tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "POST /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.109198 Jul 25 19:11:14.424221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 325/637] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:11:13 2022] POST /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388/os-volume_attachments => generated 194 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:11:31.267037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:31.267774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=48 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:31.380074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:31.380563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:31.386665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:31.387106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:31.387864 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:31.388298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:31.413315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dafd1221-45f0-433b-a172-2ad23524ac8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/ips" status: 200 len: 152 microversion: 2.20 time: 0.151356 Jul 25 19:11:31.413782 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 313/638] 10.222.0.17 () {60 vars in 1289 bytes} [Mon Jul 25 19:11:31 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/ips => generated 152 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:11:40.086821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:11:40.087384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:40.089730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=24 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:40.090564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:40.095676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:40.096116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:40.096927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:40.097348 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:40.121117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lazy-loading 'flavor' on Instance uuid 455a6d7b-3a62-47e8-8eca-526bc28307de {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:11:40.596508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-280965da-4e4d-4332-8c52-d55b3a780153 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/action" status: 202 len: 0 microversion: 2.20 time: 0.513825 Jul 25 19:11:40.597108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 326/639] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Jul 25 19:11:40 2022] POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:11:40.605674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:40.607212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:40.615362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:40.615861 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:40.616634 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:40.617069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:40.758716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:40.767656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:40.769169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:40.770356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f5a75b90-e4a8-428d-98da-30a4f6dc25ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.168751 Jul 25 19:11:40.770916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 314/640] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:40 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:41.797825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:41.798562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:41.805301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:41.807309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:41.807309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:41.807309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:41.969861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:41.978757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:41.980327 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:41.982254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3500a0f7-326a-4a51-a3bc-2d22d2ddab6e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.190160 Jul 25 19:11:41.982859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 327/641] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:41 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:42.185643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:42.186310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:42.194533 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:42.195325 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:42.196448 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:42.196886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:42.366186 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lazy-loading 'services' on Instance uuid 705fce8e-42d6-4006-90cb-feb4eff8c388 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:11:42.641002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-884bb611-ab3e-40cc-bce5-75c6bf8d0c32 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388/os-volume_attachments/5e48cde9-1fe3-4cb8-a28c-45a07190670e" status: 202 len: 0 microversion: 2.1 time: 0.459529 Jul 25 19:11:42.641639 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 315/642] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:11:42 2022] DELETE /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388/os-volume_attachments/5e48cde9-1fe3-4cb8-a28c-45a07190670e => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:11:43.013941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:43.014584 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:43.021208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:43.021658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:43.022525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:43.022973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:43.164774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:43.173441 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:43.175002 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:43.176171 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a8ad2e5f-16a7-4223-b505-ef383dc7d705 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.166940 Jul 25 19:11:43.176733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 328/643] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:43 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:44.202142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:44.202871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:44.209616 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:44.210057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:44.210844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:44.211277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:44.360709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:44.369068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:44.370626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:44.371777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b2a5e3b7-77bd-4c6a-b67d-67aa767fcbe2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.174419 Jul 25 19:11:44.372330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 316/644] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:44 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:11:44.827485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:44.828107 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:44.834516 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:44.834970 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:44.835742 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:44.836178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:44.862225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:11:45.161168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ab9ba341-33f1-429c-97c2-da54c50b6af1 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "DELETE /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 204 len: 0 microversion: 2.1 time: 0.338246 Jul 25 19:11:45.161765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 329/645] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:11:44 2022] DELETE /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:11:45.170594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:45.171210 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:45.177321 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:45.177770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:45.178572 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:45.179008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:45.312974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:45.320391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-14edfb55-da3d-4ab5-9a16-991187a419f6 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1512 microversion: 2.1 time: 0.154431 Jul 25 19:11:45.320949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 317/646] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:45 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:45.396789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:45.397481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:45.403865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:45.404314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:45.405169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:45.405529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:45.541463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:45.549803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:45.551351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:45.552511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4ca76d0e-8e68-4e9a-83fb-bc625b6588c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.160094 Jul 25 19:11:45.553072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 330/647] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:45 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:46.343217 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:46.343846 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:46.350369 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:46.350819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:46.351587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:46.352021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:46.486583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:46.494426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e021942c-fc73-4c6a-95fc-a9cad5972c01 tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1512 microversion: 2.1 time: 0.155753 Jul 25 19:11:46.494994 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 318/648] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:46 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:46.577098 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:46.577730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:46.584381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:46.584823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:46.585579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:46.586013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:46.719964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:46.728241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:46.729768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:46.730980 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b2c05974-02bb-4df1-aeff-cc2d79ee90a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.158668 Jul 25 19:11:46.731540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 331/649] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:46 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:47.516876 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:47.517479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:47.525301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:47.525750 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:47.526861 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:47.527027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:47.673011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:47.681323 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7addc012-11be-4b82-b821-0ccfb884a81f tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1512 microversion: 2.1 time: 0.168821 Jul 25 19:11:47.681913 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 319/650] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:47 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:47.753416 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:47.754035 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:47.760613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:47.761060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:47.761833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:47.762316 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:47.980832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:47.988861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:47.990432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:47.991556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5c418daf-ef10-4618-a7cd-9fd337112320 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.242326 Jul 25 19:11:47.992300 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 332/651] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:47 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:48.234558 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-3a00a0e5-202b-4127-853d-02136ca24c5c req-6b9b4ba6-fecc-469e-8217-93554150a378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705fce8e-42d6-4006-90cb-feb4eff8c388", "name": "network-vif-deleted", "tag": "4ae7a041-6149-45ea-9d92-dd492aac3de2"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:11:48.243965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-3a00a0e5-202b-4127-853d-02136ca24c5c req-6b9b4ba6-fecc-469e-8217-93554150a378 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:48.244403 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-3a00a0e5-202b-4127-853d-02136ca24c5c req-6b9b4ba6-fecc-469e-8217-93554150a378 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:48.256149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-3a00a0e5-202b-4127-853d-02136ca24c5c req-6b9b4ba6-fecc-469e-8217-93554150a378 service nova] Creating event network-vif-deleted:4ae7a041-6149-45ea-9d92-dd492aac3de2 for instance 705fce8e-42d6-4006-90cb-feb4eff8c388 on hv-cinder-82002 Jul 25 19:11:48.261212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-3a00a0e5-202b-4127-853d-02136ca24c5c req-6b9b4ba6-fecc-469e-8217-93554150a378 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Jul 25 19:11:48.261866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 320/652] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:11:48.703959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:48.704569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:48.710627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:48.711138 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:48.711842 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:48.712273 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:48.744174 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:48.744620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:48.745068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lazy-loading 'fault' on Instance uuid 705fce8e-42d6-4006-90cb-feb4eff8c388 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:11:48.787830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5321524c39c14135b5cc77e21598cbe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387ac04100224395a581aa382deb19b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:48.795860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-658130e8-2ef4-4c1d-94f3-0a7cd209027d tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 200 len: 1308 microversion: 2.1 time: 0.096560 Jul 25 19:11:48.796401 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 333/653] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:48 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:11:49.016762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:49.017360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:49.025397 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:49.026165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:49.027364 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:49.028690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:49.216134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:49.224390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:49.225900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:49.230225 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f51a0c6f-a1af-45ed-96db-58850fc1a7dc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.215680 Jul 25 19:11:49.230225 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 321/654] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:49 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:49.819118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:49.819820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] [instance: 705fce8e-42d6-4006-90cb-feb4eff8c388] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:49.827655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:49.828103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:49.828900 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:49.829332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:49.844515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] HTTP exception thrown: Instance 705fce8e-42d6-4006-90cb-feb4eff8c388 could not be found. Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Request method failure captured: Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 HTTP/1.1 Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3unBeDjrbkKF8zgfZnsJRT-nyaR3iK2HGq6OdMdljWKxAexYVafJI04DWArfrsOdHs5-Nt2vA8tOy9rXVIsfNxoM_icBYBtmBE4Z4HJLWhKS_pjoERnKOfsOVadrnIpmnshHiBdLo6gt7CCdgzAsv99LmT9nH6uggLlwNOYFKecWhTE Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 387ac04100224395a581aa382deb19b0 Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1708046868 Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:11:49.846178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/387ac04100224395a581aa382deb19b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/387ac04100224395a581aa382deb19b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/387ac04100224395a581aa382deb19b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_387ac04100224395a581aa382deb19b0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesSnapshotTestJSON-1708046868 Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 387ac04100224395a581aa382deb19b0 Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1708046868 Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesSnapshotTestJSON-1708046868-project Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 5321524c39c14135b5cc77e21598cbe1 Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesSnapshotTestJSON-1708046868-project Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 705fce8e-42d6-4006-90cb-feb4eff8c388 could not be found. Jul 25 19:11:49.847824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '705fce8e-42d6-4006-90cb-feb4eff8c388'} Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705fce8e-42d6-4006-90cb-feb4eff8c388 could not be found. Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:11:49.848709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705fce8e-42d6-4006-90cb-feb4eff8c388 could not be found. Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705fce8e-42d6-4006-90cb-feb4eff8c388 could not be found. Jul 25 19:11:49.850169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:11:49.851916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] Returning 404 to user: Instance 705fce8e-42d6-4006-90cb-feb4eff8c388 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:11:49.851916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c42c7568-f9a5-4e24-894d-4b57c2d369bb tempest-VolumesSnapshotTestJSON-1708046868 tempest-VolumesSnapshotTestJSON-1708046868-project] 10.222.0.17 "GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388" status: 404 len: 111 microversion: 2.1 time: 0.032449 Jul 25 19:11:49.851916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 334/655] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:11:49 2022] GET /compute/v2.1/servers/705fce8e-42d6-4006-90cb-feb4eff8c388 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:11:50.253884 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:50.254554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:50.262038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:50.262818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:50.263441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:50.263882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:50.399862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:50.408969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:50.410564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:50.411793 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e78b0eaa-a0f7-4073-b131-cd67b24a344e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.162224 Jul 25 19:11:50.412374 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 322/656] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:50 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:51.437619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:51.438230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:51.445031 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:51.445480 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:51.446249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:51.446710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:51.584857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:51.593742 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:51.596753 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:51.596753 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-48d4cd86-821f-4ddd-90a1-a8bf4af842a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.165080 Jul 25 19:11:51.596981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 335/657] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:51 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:52.620683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:52.621485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:52.629348 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:52.629805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:52.630613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:52.631055 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:52.765869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:52.774137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:52.775683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:52.776926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a4799e74-315f-4f4b-818f-765a98db86d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.160183 Jul 25 19:11:52.777489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 323/658] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:52 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:53.051085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:53.051667 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:53.057874 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:53.058317 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:53.059338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:53.059755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:53.084659 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-759ca744-aea5-4f89-b65a-d41105dd8e39 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/ips" status: 200 len: 145 microversion: 2.1 time: 0.037446 Jul 25 19:11:53.085240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 336/659] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:11:53 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:11:53.800921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:53.801589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:53.808186 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:53.808631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:53.810048 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:53.810526 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:53.952207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:53.961869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:53.963607 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:53.964765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-45287b60-6fc0-4616-88f9-48569dc731c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.168022 Jul 25 19:11:53.965986 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 324/660] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:53 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:54.994514 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:54.995118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:55.003490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:55.003944 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:55.004935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:55.005373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:55.145931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:55.155143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:55.156941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:55.158052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1f41f343-c3ee-48ed-bee0-2cc0aaaf3923 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.167739 Jul 25 19:11:55.158803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 337/661] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:54 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:56.181232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:56.181867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:56.189318 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:56.189766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:56.190575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:56.191012 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:56.322603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:56.330937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:56.332350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:56.333507 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e81121a0-6c7f-4006-917b-30cc84100ab7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.156206 Jul 25 19:11:56.334071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 325/662] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:56 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:57.356958 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:57.357567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:57.364191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:57.364638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:57.365434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:57.365871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:57.496546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:57.506465 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:57.507983 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:57.509159 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7c02eaf3-06e7-4a0c-a9b9-16baa59d488d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.156314 Jul 25 19:11:57.509707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 338/663] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:57 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:11:58.535350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:58.536005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:58.542603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:58.543046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:58.544580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:58.545114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:58.679851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:58.688769 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:58.690475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:58.691688 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d6cc2caa-698e-4110-8f45-6a9b0f166584 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.161235 Jul 25 19:11:58.692239 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 326/664] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:58 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:11:59.717502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:11:59.718124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:11:59.725119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:59.725566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:59.726428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:11:59.726866 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:11:59.752530 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:59.872731 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:59.881135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:59.882946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:11:59.884157 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ef3eecce-2255-4e18-9dcc-fd361a5940ef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.171537 Jul 25 19:11:59.884709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 339/665] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:11:59 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:00.140080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ec98785-e964-430d-a552-cb62e869458e"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:00.142534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:00.148835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:00.149282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:00.154479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:00.154479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:00.908891 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:00.909467 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:00.917165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:00.917612 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:00.918424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:00.919114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:01.060627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:01.069036 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:01.070621 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:01.075504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8d01d0fe-96c8-42b3-ae1f-7e9cccc260ba tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.167311 Jul 25 19:12:01.075504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 340/666] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:00 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:01.296704 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f1c090fb-b16d-42a8-b11b-d2a4d23c1873 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.160710 Jul 25 19:12:01.297503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 327/667] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:12:00 2022] POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-volume_attachments => generated 194 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:12:02.095955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:02.096760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:02.103761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:02.104211 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:02.104995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:02.105429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:02.238760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:02.247897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:02.249453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:02.251248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6ee7ebd8-dc4a-4a7c-8f6f-7760c0b1c172 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.158771 Jul 25 19:12:02.251476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 341/668] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:02 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:03.281099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:03.281792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:03.288043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:03.288482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:03.289249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:03.289680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:03.310768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:03.427889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:03.438515 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:03.440032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:03.441213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-189257a1-8e0f-4e24-9bd5-84e2abfe6582 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.165675 Jul 25 19:12:03.448647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 328/669] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:03 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:04.472747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:04.473326 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:04.479640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:04.480066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:04.480847 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:04.481277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:04.621243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:04.630285 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:04.631814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:04.633032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c1b3c6ab-c1e4-4c0a-9d5e-23091047dc3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.164692 Jul 25 19:12:04.633546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 342/670] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:04 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:05.656396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:05.656999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:05.663797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:05.664254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:05.665233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:05.665691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:05.803623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:05.812002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:05.814569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:05.814709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8184fa4f-fdcc-407e-8cf5-ee8626fdd0de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.162571 Jul 25 19:12:05.815263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 329/671] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:05 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:06.838319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:06.838956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:06.846108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:06.846598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:06.847370 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:06.847809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:06.977363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:06.985690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:06.987237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:06.988385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-43fd3fa0-38eb-4849-9967-17a78d2942a2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.154066 Jul 25 19:12:06.988936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 343/672] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:06 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:08.012416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:08.013049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:08.020191 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:08.020638 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:08.021404 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:08.021839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:08.149767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:08.158728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:08.160240 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:08.161467 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a7003e1f-2594-4027-8487-ec5836784da7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.152995 Jul 25 19:12:08.161927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 330/673] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:08 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:08.720955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-3fcc2204-911f-4d63-884b-ceda7733f8ef req-fc0a6550-e823-4c2a-b650-51c26fca4dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "name": "network-vif-plugged", "status": "completed", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:08.731097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-3fcc2204-911f-4d63-884b-ceda7733f8ef req-fc0a6550-e823-4c2a-b650-51c26fca4dd6 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:08.731541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-3fcc2204-911f-4d63-884b-ceda7733f8ef req-fc0a6550-e823-4c2a-b650-51c26fca4dd6 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:08.745023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-3fcc2204-911f-4d63-884b-ceda7733f8ef req-fc0a6550-e823-4c2a-b650-51c26fca4dd6 service nova] Creating event network-vif-plugged:e40ea0fc-afa9-4060-9acf-75154697423d for instance 455a6d7b-3a62-47e8-8eca-526bc28307de on hv-cinder-82002 Jul 25 19:12:08.751206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-3fcc2204-911f-4d63-884b-ceda7733f8ef req-fc0a6550-e823-4c2a-b650-51c26fca4dd6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033760 Jul 25 19:12:08.751917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 344/674] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:12:09.185003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:09.185636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:09.192950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:09.193390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:09.194143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:09.194601 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:09.323080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:09.331464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:09.332958 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:09.334130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-51dc8254-dc06-4e9d-99d9-b41837e3dcda tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.153174 Jul 25 19:12:09.334707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 331/675] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:09 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:10.015886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:10.018223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:10.024500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:10.025028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:10.025720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:10.026154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:10.260853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8f04019b-fd09-4007-9e83-e3973d3258f2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/action" status: 200 len: 28716 microversion: 2.1 time: 0.387077 Jul 25 19:12:10.261503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 345/676] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:12:09 2022] POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/action => generated 28716 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:12:10.357116 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:10.358222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:10.365024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:10.365473 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:10.366242 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:10.366703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:10.504001 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:10.512202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:10.513707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:10.514899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9c0fc229-2c64-4eba-8538-deb1745f78a0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.161860 Jul 25 19:12:10.515461 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 332/677] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:10 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:11.538491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:11.540100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:11.541577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:11.547012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:11.547456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:11.548225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:11.548657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:11.692300 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:11.701150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:11.703806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:11.704980 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5cd03953-2935-47d8-ba20-c361a116091b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.170915 Jul 25 19:12:11.705529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 346/678] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:11 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:12.728459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:12.767747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:12.767747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=41 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:12.767747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:12.767747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:12.768633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:12.768633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:12.874175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:12.883577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:12.885335 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:12.886532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-588ae0e1-b726-4f9a-9562-1adc20edc739 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.162150 Jul 25 19:12:12.887095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 333/679] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:12 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:13.088709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-23e91d8a-5699-49c1-af77-a799f32757df tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:13.095925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-23e91d8a-5699-49c1-af77-a799f32757df tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:13.096374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-23e91d8a-5699-49c1-af77-a799f32757df tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:13.157085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-23e91d8a-5699-49c1-af77-a799f32757df tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Going to try to stop instance {{(pid=125166) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 19:12:13.357747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-23e91d8a-5699-49c1-af77-a799f32757df tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action" status: 202 len: 0 microversion: 2.1 time: 0.272968 Jul 25 19:12:13.361820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 347/680] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:12:13 2022] POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:12:13.369567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:13.370199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:13.380696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:13.380696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:13.380696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:13.380696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:13.524353 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:13.534065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6be1b82d-d7e0-43d5-b262-0d46db8389a0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.170481 Jul 25 19:12:13.534684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 334/681] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:13 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:13.910170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:13.910883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:13.917176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:13.917643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:13.918427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:13.918857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:14.090870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:14.099192 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:14.100710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:14.101953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-badf1399-50f4-42b8-a7ed-551d6160e322 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1746 microversion: 2.20 time: 0.196630 Jul 25 19:12:14.102544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 348/682] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:13 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1746 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:14.556608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:14.557219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:14.565194 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:14.565760 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:14.566618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:14.567115 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:14.717239 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:14.726167 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2d4b229c-88be-4ae8-b942-51bba9cba887 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.173532 Jul 25 19:12:14.727268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 335/683] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:14 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:15.127354 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:15.128057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:15.135282 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:15.136065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:15.137103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:15.137754 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:15.292391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:15.302051 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:15.303786 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:15.305227 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7befad19-9bc7-491b-b27e-9a5a1c1de8a4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.183094 Jul 25 19:12:15.319099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 349/684] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:15 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:15.749928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:15.751046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:15.758994 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:15.760460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:15.761699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:15.763234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:15.929657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:15.939922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-baa4cd09-8741-4a7e-8290-03b96b473427 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.195182 Jul 25 19:12:15.941444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 336/685] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:15 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:16.331740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:16.332349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:16.339880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:16.340384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:16.341662 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:16.342513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:16.501516 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:16.511167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:16.513212 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:16.514846 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e0f622b9-a6a2-473b-b367-336531ff430d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.187735 Jul 25 19:12:16.515393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 350/686] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:16 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:16.964164 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:16.964788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:16.973289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:16.973867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:16.974688 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:16.975132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:17.117444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:17.126803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9e7533e3-f87a-4a52-8e0d-23e0a66af98f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.168398 Jul 25 19:12:17.127543 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 337/687] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:16 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:17.539557 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:17.540830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:17.548319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:17.548762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:17.549523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:17.549950 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:17.706375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:17.714245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:17.715797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:17.716951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-27615236-3234-429f-89d8-9236cc75852c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.181306 Jul 25 19:12:17.717511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 351/688] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:17 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:18.150257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:18.151269 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:18.162145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:18.162827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:18.163781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:18.164376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:18.318599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:18.326614 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-db8dd15f-c67f-4fe3-bda0-18f04e3f0d8e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.180428 Jul 25 19:12:18.327742 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 338/689] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:18 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:18.740286 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:18.740876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:18.753796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:18.753796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:18.753796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:18.753796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:18.886392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:18.895714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:18.897306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:18.898654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9a178cf8-989b-4e08-9617-35c63db91572 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.162214 Jul 25 19:12:18.899328 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 352/690] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:18 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:19.349996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:19.350557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:19.357376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:19.358106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:19.359279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:19.360193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:19.742497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:19.750177 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b61427b6-1a25-4a74-adde-49d403b58619 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.404070 Jul 25 19:12:19.751233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 339/691] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:19 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:19.925224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:19.926228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:19.934930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:19.935674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:19.936989 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:19.937593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:20.110044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:20.123905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:20.126478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:20.127701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-01e2a666-4ce0-4dcc-8586-08a7fce2d9e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.207518 Jul 25 19:12:20.139425 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 353/692] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:19 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:20.773889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:20.774855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:20.785161 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:20.785635 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:20.786475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:20.787309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:20.952624 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:20.973749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-490d336f-99fe-48ea-b8eb-52c86a1af8ad tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.193064 Jul 25 19:12:20.973749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 340/693] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:20 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:12:21.151618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:21.152899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:21.160844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:21.161532 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:21.163125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:21.163733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:21.314302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:21.322957 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:21.325142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:21.326690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4e2eadd0-0201-45e1-80d1-14aea0ebebaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.179139 Jul 25 19:12:21.328097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 354/694] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:21 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:21.990196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:21.991241 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:21.998747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:21.999436 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:22.000694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:22.001239 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:22.141692 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:22.149901 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bc968eeb-bc9e-493f-932d-f055250f7167 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.164059 Jul 25 19:12:22.150504 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 341/695] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:21 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:22.352178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:22.355780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:22.360598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:22.361199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:22.362394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:22.363034 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:22.512520 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:22.522478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:22.524520 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:22.525907 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-282281f7-ca78-4a0d-91e6-c934ce077421 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.178102 Jul 25 19:12:22.526825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 355/696] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:22 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:23.174254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:23.175150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:23.182509 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:23.183230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:23.184199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:23.184963 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:23.351242 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:23.366033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8cd3e42b-23cb-4e36-ac5a-35a1c88563f6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.196070 Jul 25 19:12:23.367113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 342/697] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:23 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:23.555606 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:23.556133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:23.564233 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:23.564915 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:23.565872 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:23.566309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:23.571441 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:23.729664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:23.739091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:23.741207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:23.742906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0866b713-1215-4a0c-877d-ec8e117a024c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.191231 Jul 25 19:12:23.743956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 356/698] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:23 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:24.390051 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:24.391442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:24.408447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:24.408447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:24.408447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:24.408818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:24.622529 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:24.633213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8e4958d2-c9a6-45bf-a14c-78b40fff9494 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.247801 Jul 25 19:12:24.634202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 343/699] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:24 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:24.768835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:24.770218 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:24.776736 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:24.777188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:24.778156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:24.778791 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:24.947657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:24.971972 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:24.973812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:24.975220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7a9ddc23-4973-4afd-81e7-631d6cfb830a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.210869 Jul 25 19:12:24.975879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 357/700] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:24 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:25.655949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:25.656490 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:25.663222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:25.663671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:25.664440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:25.664875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:25.801909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:25.810035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6f1152a3-32ce-416b-9b05-e352fd4b1117 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.158304 Jul 25 19:12:25.810643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 344/701] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:25 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:26.001900 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:26.002892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:26.009624 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:26.010065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:26.010897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:26.011334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:26.150196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:26.158704 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:26.160194 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:26.161772 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-23771f26-d8ce-41ef-9464-ab81043c2a72 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.164219 Jul 25 19:12:26.161875 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 358/702] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:25 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:26.835831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:26.837215 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:26.845944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:26.846727 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:26.847667 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:26.848266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:26.880141 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=100 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:27.010974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:27.024592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-275f126a-6e00-45ef-b123-29972e4f10c1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.195929 Jul 25 19:12:27.035342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 345/703] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:26 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:27.185366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:27.186080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:27.192790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:27.193240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:27.194000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:27.194475 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:27.353779 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:27.362513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:27.364096 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:27.365261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-77437e97-57c9-49df-bd35-42c265c3a58f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.183839 Jul 25 19:12:27.365821 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 359/704] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:27 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:28.050226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:28.050908 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:28.057906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:28.058382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:28.059160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:28.059592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:28.219038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:28.227431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1090cf03-9b69-46d8-89c8-e1577df0be14 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1721 microversion: 2.1 time: 0.181878 Jul 25 19:12:28.233557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 346/705] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:28 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:28.389207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:28.389894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:28.396830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:28.397279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:28.398044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:28.398510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:28.554655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:28.563464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:28.564956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:28.566106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-67ee3499-a892-4f9d-8457-f984d21678c4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1741 microversion: 2.20 time: 0.180974 Jul 25 19:12:28.566706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 360/706] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:28 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:29.251280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:29.252488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:29.263566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.264922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.269641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.269641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.417807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:29.427156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4573143e-f78f-490f-adff-0cc516df5e37 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1698 microversion: 2.1 time: 0.181585 Jul 25 19:12:29.427898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 347/707] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:29 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:12:29.449163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f99eae31-c0a9-4ce1-b1ba-23076d974a47 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:29.456749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f99eae31-c0a9-4ce1-b1ba-23076d974a47 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.457485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f99eae31-c0a9-4ce1-b1ba-23076d974a47 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.481391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f99eae31-c0a9-4ce1-b1ba-23076d974a47 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Going to try to start instance {{(pid=125166) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 19:12:29.589219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:29.590560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:29.597284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.597890 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.598794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.599342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.756044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:29.767386 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:29.769019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:29.771656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-38d6fd95-c7d7-4ec0-875a-3b6a063a147b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1723 microversion: 2.20 time: 0.186323 Jul 25 19:12:29.782187 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 348/708] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:29 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:29.803638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f99eae31-c0a9-4ce1-b1ba-23076d974a47 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action" status: 202 len: 0 microversion: 2.1 time: 0.358218 Jul 25 19:12:29.804595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 361/709] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:12:29 2022] POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:12:29.813095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:29.813740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:29.820008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.820732 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.821765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:29.822180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:29.980282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:29.991921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b14f4b7f-4e7d-4892-811a-39dee177fd60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1707 microversion: 2.1 time: 0.183090 Jul 25 19:12:29.992810 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 349/710] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:29 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1707 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:12:30.796979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:30.797919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:30.805414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:30.806214 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:30.807225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:30.807959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:31.016114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:31.017542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:31.032068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:31.032068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:31.032068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:31.032365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:31.194140 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:31.200260 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:31.208989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4b3247c0-cfbc-4a4b-a65d-6e55880d42d5 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1707 microversion: 2.1 time: 0.196445 Jul 25 19:12:31.210566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 350/711] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:31 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1707 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:12:31.229334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:31.231890 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:31.234119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-28be1c41-a81b-4e2e-b0fe-232a67f7aa1d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1723 microversion: 2.20 time: 0.441187 Jul 25 19:12:31.235279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 362/712] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:30 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:32.231526 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:32.232132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:32.240333 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.241543 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.242090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.242573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.260222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:32.260797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:32.270619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.271316 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.272814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.272814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.440205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:32.449516 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:32.451453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:32.453569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d53f2f1b-3b06-4804-947c-232b24b3048c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1666 microversion: 2.20 time: 0.198244 Jul 25 19:12:32.465666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 363/713] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:32 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1666 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:32.479328 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f12acf9d-e233-4506-ae37-fc66af6ccc9d"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:32.482408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:32.489217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.489675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.490781 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.491288 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.498307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:32.508291 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fa52e16f-487f-4446-9eb2-8ed62388cc7e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1707 microversion: 2.1 time: 0.280548 Jul 25 19:12:32.509580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 351/714] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:32 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1707 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:12:32.797212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-a9392041-0bf7-4e61-9f36-c1cf92fabf31 req-d0ebbbec-1bd6-49a1-a1bc-d33a1d944c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "name": "network-vif-unplugged", "status": "completed", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:32.817971 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-a9392041-0bf7-4e61-9f36-c1cf92fabf31 req-d0ebbbec-1bd6-49a1-a1bc-d33a1d944c36 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:32.817971 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-a9392041-0bf7-4e61-9f36-c1cf92fabf31 req-d0ebbbec-1bd6-49a1-a1bc-d33a1d944c36 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:32.837663 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.compute.server_external_events [req-a9392041-0bf7-4e61-9f36-c1cf92fabf31 req-d0ebbbec-1bd6-49a1-a1bc-d33a1d944c36 service nova] Unable to find a host for instance 455a6d7b-3a62-47e8-8eca-526bc28307de. Dropping event network-vif-unplugged {{(pid=125167) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 19:12:32.838968 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-a9392041-0bf7-4e61-9f36-c1cf92fabf31 req-d0ebbbec-1bd6-49a1-a1bc-d33a1d944c36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047103 Jul 25 19:12:32.840105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 352/715] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 19:12:33.532630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:33.533299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:33.540060 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:33.540508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:33.541275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:33.541699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:33.755392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:33.764351 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9498dc8c-900f-46da-80e3-9d7d05a86cea tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1711 microversion: 2.1 time: 0.235812 Jul 25 19:12:33.767934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 353/716] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:12:33 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1711 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:12:34.050707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b32dec67-76a1-4008-b7c8-330e47b5d4a8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.575495 Jul 25 19:12:34.056206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 364/717] 10.222.0.17 () {62 vars in 1364 bytes} [Mon Jul 25 19:12:32 2022] POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments => generated 188 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:12:34.223734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:34.224845 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:34.239082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:34.240251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:34.241120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:34.241771 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:34.506665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7f1277ef-fd09-4ee9-adec-24fc3a7ae255 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/action" status: 202 len: 0 microversion: 2.20 time: 0.292411 Jul 25 19:12:34.508245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 354/718] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Jul 25 19:12:34 2022] POST /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:12:34.517773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:34.518783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:34.527228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:34.527680 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:34.528559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:34.530455 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:34.696496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:34.707645 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:34.709445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:34.711206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0cec99e6-8a42-432f-9d44-66f7fab6be89 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1752 microversion: 2.20 time: 0.198998 Jul 25 19:12:34.712022 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 365/719] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:34 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:35.737574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:35.738062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:35.747749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:35.748193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:35.749532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:35.750213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:35.986713 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:35.997319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:35.999826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:36.002168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-af912fbc-fbf0-4c9e-aec2-d0dba915bd26 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1752 microversion: 2.20 time: 0.269996 Jul 25 19:12:36.003340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 355/720] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:35 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1752 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:37.030708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:37.032692 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:37.040799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:37.041850 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:37.043277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:37.043977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:37.587518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:37.600361 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:37.602001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:37.603614 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8b0cb8b6-77ff-41dd-a14e-1106c0f04c8f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1752 microversion: 2.20 time: 0.578489 Jul 25 19:12:37.604695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 366/721] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:37 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1752 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:38.629215 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:38.630603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:38.637632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:38.638491 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:38.640398 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:38.641015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:38.862050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:38.883102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:38.884788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:38.885992 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f4bb5be2-2c7e-47e2-b54a-35a2710176a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1752 microversion: 2.20 time: 0.261595 Jul 25 19:12:38.892780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 356/722] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:38 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1752 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:39.917116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:39.918541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:39.925262 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:39.925716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:39.926794 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:39.927039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:40.178626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:40.188508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:40.190354 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:40.191537 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-29f68b92-b4d3-4691-9a77-f6c4e6a29863 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1754 microversion: 2.20 time: 0.278269 Jul 25 19:12:40.192267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 367/723] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:39 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1754 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:41.218956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:41.223300 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:41.236408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:41.237148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:41.238124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:41.238844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:41.444318 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:41.460584 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:41.462688 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:41.464172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dde06138-62dc-4c1a-99fd-621e96a312c6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.251240 Jul 25 19:12:41.464742 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 357/724] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:41 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:42.446295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6eece6b4-4449-41c1-9177-a74a9be3769c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Action: 'create', calling method: .version_select at 0x7fd8e5b0b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-502373297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9q7vR0+tMsX7JjuVYb1kwNj3TnOgU6UpCVGZrPSppDuGQpFeUMpl1xiEOQz3jIoCfxhm35w9NcTMvMSPffJSq+EHb4PRab9xlv+t7ImRL2uZuG6MYQygtc75rg1WFDNg=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:42.466586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-6eece6b4-4449-41c1-9177-a74a9be3769c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Getting quotas for project 019f72079acf4a74bd1a0706041e6678. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:12:42.475555 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-6eece6b4-4449-41c1-9177-a74a9be3769c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Getting quotas for user 9631ec5df93c42df9d2f60bedfef6507 and project 019f72079acf4a74bd1a0706041e6678. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:12:42.493018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:42.494950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:42.504886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:42.505712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:42.506298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:42.506639 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:42.687819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6eece6b4-4449-41c1-9177-a74a9be3769c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.417691 Jul 25 19:12:42.688499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 368/725] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:12:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:12:42.699439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:42.699439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:42.701137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:42.703134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a0d2b527-5636-4efc-84ff-59560865ca80 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.216324 Jul 25 19:12:42.703913 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 358/726] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:42 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:43.732529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:43.734042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:43.736715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:43.751687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:43.752827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:43.754128 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:43.754931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:43.954068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:43.965497 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:43.967070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:43.968623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f47c96e7-ca44-400b-a57f-47b2f93a5aef tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.241118 Jul 25 19:12:43.968959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 369/727] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:43 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:44.992159 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:44.992791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:44.995335 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=54 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:45.016959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:45.016959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:45.016959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:45.016959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:45.191553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:45.202420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:45.204353 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:45.205548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f43545cb-2bde-4278-8052-328a23a9a17a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.217484 Jul 25 19:12:45.206601 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 359/728] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:44 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:46.231822 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:46.232510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:46.261852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:46.261852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:46.261852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:46.261852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:46.267295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:46.502877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:46.514133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:46.516779 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:46.518295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3ef1c783-5c65-42c5-b9e6-c5275055ea62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.290778 Jul 25 19:12:46.519376 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 370/729] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:46 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:47.543652 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:47.544309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:47.551788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:47.552232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:47.552990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:47.553455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:48.018160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:48.029149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:48.032017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:48.033404 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-35af615a-d9e2-44a7-b0d4-bbf983e38136 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.493646 Jul 25 19:12:48.034553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 360/730] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:47 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:49.062694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:49.063575 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:49.074050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:49.098205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:49.098205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:49.098205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:49.231042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:49.240607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:49.242485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:49.243705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-670a88df-9c01-4f66-84c0-b4eab9a563c8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.188646 Jul 25 19:12:49.244265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 371/731] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:49 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:49.386647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e06cdae-616c-488a-a554-3c07c58666ac"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:12:49.390134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:49.410274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:49.412225 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:49.413007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:49.413453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:49.437921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:50.269302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:50.269962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:50.276835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:50.277302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:50.278665 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:50.278665 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:50.431476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:50.442485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:50.444027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:50.445204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c40d3159-4f5e-41d3-bbf1-d90f65cda942 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.181007 Jul 25 19:12:50.445749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 372/732] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:50 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:51.472117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:51.472910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:51.479261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:51.479705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:51.480472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:51.480903 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:51.633306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:51.643029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:51.644964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:51.646597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9a4d920d-b018-4a20-8670-4f66801722de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.178236 Jul 25 19:12:51.647456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 373/733] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:51 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:12:52.671853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:52.672650 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:52.674877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=4 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:52.680959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:52.681418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:52.682364 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:52.682879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:52.845385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:52.859396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:52.860729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:52.861933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5ba15fa8-498c-4d07-a39f-c3fa4f7de084 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.194844 Jul 25 19:12:52.862841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 374/734] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:52 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:53.885685 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:53.886622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:53.893763 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:53.894233 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:53.895008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:53.895444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:54.049242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:54.059380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:54.060893 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:54.062110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-916d0259-b59e-47c5-8c03-fcb9717615cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.180451 Jul 25 19:12:54.069473 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 375/735] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:53 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:55.096289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:55.097023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:55.103889 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:55.119048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:55.119048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:55.119048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:55.244630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:55.254914 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:55.256491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:55.257748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3fd9d9fb-5058-4190-a027-8df2dc6d851a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.165561 Jul 25 19:12:55.258307 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 376/736] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:55 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:56.071755 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:12:56.087643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:12:56.283464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:56.284135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:56.290696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:56.291138 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:56.291902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:56.292333 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:56.428580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:56.437229 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:56.439588 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:56.440997 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8040b5a6-4ccf-43cb-9cca-4479f9f122b6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.162009 Jul 25 19:12:56.441558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 377/737] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:56 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:57.464329 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:57.465043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:57.472488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:57.472951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:57.473892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:57.474543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:57.615759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:57.625212 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:57.626741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:57.628132 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-351ead4b-fdf6-4109-97ee-d266c3d8383a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.168315 Jul 25 19:12:57.628696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 378/738] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:57 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:58.653490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:58.654159 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:58.661172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:58.661613 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:58.662400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:58.662835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:58.792615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:58.801626 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:58.803157 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:58.804296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cb9a7082-693e-44c2-ae48-d50a5e698e6b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.154823 Jul 25 19:12:58.804846 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 379/739] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:58 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:12:59.409144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=5 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:59.834220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:12:59.834937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:12:59.841544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:59.842009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:59.842809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:12:59.843244 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:12:59.850351 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:59.982204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:59.991346 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:59.992829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:12:59.993977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-27836629-668c-4d09-8678-6ff0d38d3f7b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.170593 Jul 25 19:12:59.994567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 380/740] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:12:59 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:01.017910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:01.018693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:01.025643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:01.026097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:01.026917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:01.027349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:01.165020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:01.173559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:01.175110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:01.176271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-eb45ceea-fb4e-4fff-a5dc-0ec80e11e138 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.163060 Jul 25 19:13:01.176826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 381/741] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:01 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:02.201513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:02.202220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:02.209429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:02.209878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:02.210691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:02.211216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:02.346740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:02.355675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:02.357188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:02.358381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8ecde92e-9601-4fb8-987c-b073536622c2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.160913 Jul 25 19:13:02.358940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 382/742] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:02 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:03.382460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:03.383146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:03.389615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:03.390052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:03.390881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:03.391307 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:03.528409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:03.537404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:03.538934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:03.540076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4c37a72a-6ec8-4085-9b11-699af5ba680b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.162102 Jul 25 19:13:03.540627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 383/743] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:03 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:04.563692 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:04.565210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:04.571727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:04.572176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:04.572947 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:04.573384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:04.706339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:04.714764 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:04.716330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:04.717464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-15549962-4a8a-47d3-9f37-78815c5680a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.157793 Jul 25 19:13:04.718009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 384/744] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:04 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:05.742155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:05.742876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:05.749516 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:05.749949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:05.750748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:05.751181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:05.890112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:05.899569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:05.901076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:05.902503 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e39ebb84-8db6-45e5-8f78-c42f4aac2e22 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.164143 Jul 25 19:13:05.907875 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 385/745] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:05 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:06.106044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-53d1eedc-0be7-43f1-83fb-cba3b319d63e tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.723611 Jul 25 19:13:06.106645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 361/746] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:12:49 2022] POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments => generated 194 bytes in 16725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:13:06.927146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:06.928066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:06.935314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:06.935762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:06.936694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:06.937124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:07.073086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:07.076627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:07.083038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:07.089706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:07.089706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-990c66b8-23ff-43e2-a8cc-1c4b02bfab60 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.163488 Jul 25 19:13:07.089706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 386/747] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:06 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:08.110071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:08.110802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:08.117560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:08.118180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:08.118985 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:08.119417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:08.263095 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:08.272965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:08.274409 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:08.275712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-434bb6fe-b184-4d74-9a38-1c57a56060d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.171164 Jul 25 19:13:08.276272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 362/748] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:08 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:09.302644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:09.303416 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:09.310110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:09.310581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:09.311352 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:09.311777 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:09.455152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:09.464473 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:09.466048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:09.467230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-29b24d01-d31a-4a06-bd99-b3a7c96504f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.169795 Jul 25 19:13:09.467784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 387/749] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:09 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:10.492103 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:10.492713 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:10.499566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:10.500015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:10.500779 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:10.501215 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:10.637068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:10.645912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:10.647434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:10.648592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1e6e63e9-9ee5-4990-a336-b992dc0575de tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.160525 Jul 25 19:13:10.649137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 363/750] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:10 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:11.672750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:11.673291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:11.681041 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:11.681492 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:11.682259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:11.682719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:11.818245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:11.826837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:11.828324 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:11.829472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dd2678a0-0133-4e8c-bc38-01ada6a55374 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.160861 Jul 25 19:13:11.830021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 388/751] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:11 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:12.853310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:12.853927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:12.860392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:12.860812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:12.861575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:12.862016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:12.989920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:12.998359 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:13.000232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:13.001380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a5bb7f36-a8d2-4968-a7d0-a0c48feae0d1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.152229 Jul 25 19:13:13.001936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 364/752] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:12 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:14.025985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:14.026703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:14.029363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=40 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:14.035570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:14.036003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:14.036787 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:14.037217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:14.184491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:14.192698 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:14.194174 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:14.195334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-94956773-a512-45ba-ae08-3796794faf0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.173779 Jul 25 19:13:14.195882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 389/753] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:14 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:15.219061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:15.219657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:15.226862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:15.227306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:15.228061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:15.228489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:15.365424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:15.375431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:15.376941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:15.378531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-862494d0-5ed6-4c31-8c43-0dceb619ab09 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.163093 Jul 25 19:13:15.379149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 365/754] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:15 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:16.403120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:16.403747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:16.412328 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:16.418001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:16.418001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:16.418001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:16.554452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:16.562951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:16.564451 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:16.566258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c7c0e19e-f5fc-4655-bfa5-6af75755be54 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.167173 Jul 25 19:13:16.566845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 390/755] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:16 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:16.843081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:16.845371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:16.852796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:16.853234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:16.854043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:16.854508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:16.879739 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'flavor' on Instance uuid 047c609b-8920-48da-a883-8ecb7c6214e9 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:13:17.254821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-23088353-6838-4b2a-a633-6fdc7d8505f6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/action" status: 200 len: 32 microversion: 2.1 time: 0.415439 Jul 25 19:13:17.255365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 366/756] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:13:16 2022] POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:13:17.265067 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:17.265677 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:17.272447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:17.272886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:17.273653 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:17.274086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:17.418393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:17.427986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3974a81d-72e1-41c1-8750-e7fe488c0eca tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.166749 Jul 25 19:13:17.428583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 391/757] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:17 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:17.463655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-2d033b55-100a-47d1-979f-774178bc6bbd req-00474483-b60c-4b65-a489-40d1c1656dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "name": "network-vif-plugged", "status": "completed", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:17.480211 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-2d033b55-100a-47d1-979f-774178bc6bbd req-00474483-b60c-4b65-a489-40d1c1656dd9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:17.480655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-2d033b55-100a-47d1-979f-774178bc6bbd req-00474483-b60c-4b65-a489-40d1c1656dd9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:17.491627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-2d033b55-100a-47d1-979f-774178bc6bbd req-00474483-b60c-4b65-a489-40d1c1656dd9 service nova] Creating event network-vif-plugged:e40ea0fc-afa9-4060-9acf-75154697423d for instance 455a6d7b-3a62-47e8-8eca-526bc28307de on hv-cinder-82002 Jul 25 19:13:17.496425 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-2d033b55-100a-47d1-979f-774178bc6bbd req-00474483-b60c-4b65-a489-40d1c1656dd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036928 Jul 25 19:13:17.501623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 367/758] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:13:17.589396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:17.590012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:17.596397 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:17.596884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:17.597661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:17.598099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:17.738853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:17.747592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:17.749369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:17.750564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c6cd76ac-dc9d-45d4-b1fb-831b14e1251e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.165359 Jul 25 19:13:17.751126 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 392/759] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:17 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:18.450885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:18.451576 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:18.458380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:18.458885 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:18.459646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:18.460110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:18.592422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:18.600950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6d4e6db4-885a-4798-ac21-c14641411367 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.154974 Jul 25 19:13:18.601580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 368/760] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:18 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:18.775402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:18.776091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:18.782740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:18.783230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:18.784552 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:18.784986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:18.995717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:19.005334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:19.006868 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:19.008048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f8e9728f-3ea6-4db5-a885-4e1ea3ab48f4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.236623 Jul 25 19:13:19.008757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 393/761] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:18 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:19.068259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-124339675", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-502373297", "security_groups": [{"name": "tempest-secgroup-smoke-127141260"}], "networks": [{"uuid": "258528fe-2a61-40c6-8c40-081c24552b12"}], "block_device_mapping_v2": [{"uuid": "be0b8719-a7cb-4c56-8768-2aea1beddaa9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:19.183970 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] validate_networks() for [('258528fe-2a61-40c6-8c40-081c24552b12', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:13:19.581870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:13:19.582512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:13:19.582813 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:13:19.583222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:13:19.583629 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:13:19.592424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:19.592866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:19.593665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:19.594097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:19.611310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Getting quotas for project 019f72079acf4a74bd1a0706041e6678. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:13:19.615888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Getting quotas for user 9631ec5df93c42df9d2f60bedfef6507 and project 019f72079acf4a74bd1a0706041e6678. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:13:19.622923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:19.623552 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:19.630969 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:19.631423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:19.632211 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:19.632645 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:19.678198 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:13:19.679912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be0b8719-a7cb-4c56-8768-2aea1beddaa9',volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:13:19.775426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:19.784210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-868472fb-db3a-418d-b85e-4ead7ccec150 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.164644 Jul 25 19:13:19.785447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 394/762] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:19 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:20.031525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:20.032135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:20.039807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:20.040256 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:20.041032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:20.041463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:20.136896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-66d6a18a-9225-4652-9149-6808124972e9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.072417 Jul 25 19:13:20.142872 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 369/763] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:13:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:13:20.149787 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4c9597ff-5451-48b6-9d7d-52ae49e5ca67 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:20.150478 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4c9597ff-5451-48b6-9d7d-52ae49e5ca67 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:20.180294 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:20.190409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:20.192019 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:20.193274 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-95d118bb-0b65-45a5-9ef4-76db480ccb0c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.165795 Jul 25 19:13:20.203324 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 395/764] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:20 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:20.213882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4c9597ff-5451-48b6-9d7d-52ae49e5ca67 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:20.221085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4c9597ff-5451-48b6-9d7d-52ae49e5ca67 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1087 microversion: 2.1 time: 0.076317 Jul 25 19:13:20.222190 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 370/765] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:20 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:20.806258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:20.806891 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:20.815994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:20.816636 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:20.817496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:20.818141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:20.961515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:20.970083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-034f1788-c935-4ee7-b7a3-95730fd35534 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.167699 Jul 25 19:13:20.970695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 396/766] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:20 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:21.216605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:21.217231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:21.225702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:21.225702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:21.226421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:21.226852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:21.244004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-71959b6c-ec41-4825-ba0e-92d04eb3860a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:21.245027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-71959b6c-ec41-4825-ba0e-92d04eb3860a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:21.303830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-71959b6c-ec41-4825-ba0e-92d04eb3860a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:21.310687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-71959b6c-ec41-4825-ba0e-92d04eb3860a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1087 microversion: 2.1 time: 0.070893 Jul 25 19:13:21.311254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 397/767] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:21 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:21.367090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:21.376282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:21.377797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:21.379075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fd3e6afe-8892-4034-8aa5-19b636054177 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1810 microversion: 2.20 time: 0.166346 Jul 25 19:13:21.379644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 371/768] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:21 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:13:21.996271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:21.996882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:22.004406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:22.004859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:22.005628 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:22.006064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:22.156572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:22.164776 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-111a0f5b-888e-4894-a086-29991c991f85 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.172405 Jul 25 19:13:22.165377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 398/769] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:21 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:22.332969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:22.333577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:22.340671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:22.341042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:22.341810 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:22.342232 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:22.402150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:22.402790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:22.410233 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:22.410716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:22.412430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:22.412886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:22.413857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:22.423942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bcb488b7-1a53-4995-8953-35abf734c3b0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1185 microversion: 2.1 time: 0.095788 Jul 25 19:13:22.425119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 372/770] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:22 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:22.577491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:22.586646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:22.588457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:22.589655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f7475cfb-8025-40c4-9cd4-6265b39d2b33 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1797 microversion: 2.20 time: 0.191681 Jul 25 19:13:22.590220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 399/771] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:13:22 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1797 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:13:23.187003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:23.187636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:23.198803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:23.199332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:23.204618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:23.204618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:23.348077 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:23.357456 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-070bd611-e6c2-474b-bf29-7ae9fc6cd121 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.174891 Jul 25 19:13:23.358038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 373/772] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:23 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:23.446715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:23.448215 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:23.464415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:23.466065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:23.467106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:23.467638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:23.661024 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:23.669692 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-02d63b39-f44c-4edd-a6ff-fe10ff504972 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1270 microversion: 2.1 time: 0.226774 Jul 25 19:13:23.670699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 400/773] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:23 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:24.382494 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:24.383214 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:24.393905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:24.394741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:24.395862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:24.396298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:24.556133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-727cb97f-f36a-4654-9545-147024f3ffad req-2863c908-235a-4e94-bcd6-e6777f19e3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:24.562898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:24.572609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4ae42af2-a07f-42c4-a3ed-3cfca8ab9fa1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.195991 Jul 25 19:13:24.587111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 374/774] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:24 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:24.590260 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-727cb97f-f36a-4654-9545-147024f3ffad req-2863c908-235a-4e94-bcd6-e6777f19e3c0 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:24.591048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-727cb97f-f36a-4654-9545-147024f3ffad req-2863c908-235a-4e94-bcd6-e6777f19e3c0 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:24.608825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-727cb97f-f36a-4654-9545-147024f3ffad req-2863c908-235a-4e94-bcd6-e6777f19e3c0 service nova] Creating event network-changed:917d51f6-d780-4f2f-b965-f032f1e24916 for instance 08be3488-9017-42d8-99ed-63e8fe344653 on hv-cinder-82002 Jul 25 19:13:24.616432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-727cb97f-f36a-4654-9545-147024f3ffad req-2863c908-235a-4e94-bcd6-e6777f19e3c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067204 Jul 25 19:13:24.617234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 401/775] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:13:24.696725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:24.698088 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:24.706824 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:24.707787 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:24.708801 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:24.709233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:24.892927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:24.902250 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a215f027-9ef9-4c7b-8708-0c6ed9ade3f7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.210404 Jul 25 19:13:24.902934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 375/776] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:24 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:25.601238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:25.602703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:25.609305 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:25.609781 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:25.610586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:25.611022 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:25.748664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:25.758236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-58dde54f-dc1b-40db-ab05-1ae1f1a8ccf7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.161371 Jul 25 19:13:25.759148 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 402/777] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:25 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:25.925541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:25.926164 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:25.932115 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:25.932549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:25.933298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:25.933720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:26.065658 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:26.073101 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b08bb2c8-2a11-4bf8-b8c2-5e98139d0a2b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.152912 Jul 25 19:13:26.073698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 376/778] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:25 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:26.786421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:26.787016 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:26.793816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:26.796538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:26.796538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:26.796538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:26.933414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:26.942020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f5c74a00-954d-435e-8eb3-ef211ee994c4 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.159847 Jul 25 19:13:26.942611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 403/779] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:26 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:27.095438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:27.096539 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:27.103480 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:27.103920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:27.104682 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:27.105110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:27.126815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:27.246315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:27.254230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6450b885-f97a-469e-8b2c-c303c0c59f3b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.162845 Jul 25 19:13:27.254859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 377/780] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:27 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:27.964044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:27.964730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:27.971544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:27.972072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:27.972861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:27.973328 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:28.103369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:28.111200 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-252cb2ee-5656-4444-aacf-a34ace301d00 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.151029 Jul 25 19:13:28.111912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 404/781] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:27 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:28.275609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:28.276329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:28.288093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:28.288545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:28.289327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:28.289763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:28.422680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:28.430703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-40c04afe-32aa-4dde-960c-30096fe33f27 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.159372 Jul 25 19:13:28.431275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 378/782] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:28 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:29.132855 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:29.133468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:29.140184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:29.140636 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:29.141413 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:29.141853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:29.146748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=100 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:29.277312 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:29.286127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bae58a77-a4e4-44b9-ad33-b7638073b4bc tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.157151 Jul 25 19:13:29.286747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 405/783] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:29 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:29.451421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:29.454379 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:29.459343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:29.459795 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:29.461030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:29.461030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:29.598174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:29.601697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:29.606195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ba6b9cc1-2cd0-4302-a16b-ddac17e768b6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.158770 Jul 25 19:13:29.606794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 379/784] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:29 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:30.310608 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:30.311383 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:30.320255 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:30.320694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:30.321471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:30.321899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:30.460053 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:30.468207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-89893ae2-5355-4914-b0db-15f9d98967e1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.163161 Jul 25 19:13:30.468788 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 406/785] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:30 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:30.627983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:30.636459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:30.636459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=8 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:30.636459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:30.637534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:30.637981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:30.638812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:30.639243 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:30.796647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:30.804669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3c9075fb-5f48-48c2-8214-0334cdec1be4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.180940 Jul 25 19:13:30.805277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 380/786] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:30 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:31.491976 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:31.492591 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:31.494496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:31.500121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:31.500567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:31.501363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:31.501795 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:31.641725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:31.650304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1c205cf6-9b18-4007-ac73-43ad33ee97d3 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.163655 Jul 25 19:13:31.650924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 407/787] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:31 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:31.837399 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:31.838001 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:31.844647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:31.845082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:31.846498 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:31.847221 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:31.990506 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:31.998637 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ef6dcdc4-f7a9-4a4c-8353-1a5851370239 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.165061 Jul 25 19:13:31.999481 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 381/788] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:31 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:32.672974 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:32.673515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:32.680875 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:32.681308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:32.682064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:32.682514 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:32.829593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:32.838943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-38f2cc8f-4549-499f-ac06-db8999582bd9 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.169674 Jul 25 19:13:32.839537 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 408/789] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:32 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:33.021733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:33.022342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:33.028981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:33.029429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:33.030200 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:33.030665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:33.172648 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:33.180997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-60597917-471d-4058-85cd-1677f7ef3d66 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.163692 Jul 25 19:13:33.181567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 382/790] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:33 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:33.862079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:33.862738 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:33.870043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:33.870517 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:33.871624 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:33.871956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:34.067585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:34.076417 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-64e785ad-2ac1-4637-a363-998bb86ec717 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.218963 Jul 25 19:13:34.077084 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 409/791] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:33 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:34.201679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:34.202282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:34.209749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:34.210195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:34.211003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:34.211438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:34.351072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:34.359199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-82eebfc3-9ea1-4e2a-8190-1730df08fa97 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.161310 Jul 25 19:13:34.359850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 383/792] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:34 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:35.100347 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:35.101373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:35.110488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:35.111155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:35.112634 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:35.113143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:35.264730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:35.273828 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4cc0e97e-8f83-4ffd-9baf-a2e9bfed4f1f tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1735 microversion: 2.1 time: 0.178017 Jul 25 19:13:35.274432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 410/793] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:35 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:35.382672 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:35.383320 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:35.390058 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:35.390729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:35.391536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:35.391973 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:35.543955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:35.555174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-08a9f447-bdb0-42ad-aed8-96e05705bd4e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.176546 Jul 25 19:13:35.555929 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 384/794] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:35 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:36.296407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:36.296997 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:36.304616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.307452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.307452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.307452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.451151 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:36.460614 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9b9a4927-f198-4066-be71-86f8e147c5b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1715 microversion: 2.1 time: 0.167712 Jul 25 19:13:36.461020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 411/795] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:36 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:36.576794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:36.578238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:36.579583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:36.580742 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:36.585975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.586733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.587864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.588002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.588088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.588189 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.588831 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.589223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.681220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] HTTP exception thrown: Cannot 'detach_volume' instance 047c609b-8920-48da-a883-8ecb7c6214e9 while it is in vm_state rescued Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Request method failure captured: Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments/6e06cdae-616c-488a-a554-3c07c58666ac HTTP/1.1 Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk6qrggI4ZdDZ3OljzMTvskbV_LrBAkfnST4XU-fpRTsNtG_FLto1q8CTbpeh4sh1JrPNS-rCyPw8VIidTfhG6Z7zd6g581q-F-CAMVpo-QrvhvSVGMCUcHuveYvtEA543E-TYXD6laTWuEeEs15TXe4KklGT0yFfbFtxM_8cV2CSY Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:13:36.682892 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08c6be8edb884214bae7a0abbf97dc16", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 7e3f168283ba4f159948830f396ae7cf Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:13:36.684478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Cannot 'detach_volume' instance 047c609b-8920-48da-a883-8ecb7c6214e9 while it is in vm_state rescued Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'server_id': '047c609b-8920-48da-a883-8ecb7c6214e9', 'id': '6e06cdae-616c-488a-a554-3c07c58666ac'} Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:13:36.685169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 047c609b-8920-48da-a883-8ecb7c6214e9 while it is in vm_state rescued Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 047c609b-8920-48da-a883-8ecb7c6214e9 while it is in vm_state rescued Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:13:36.686449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Returning 409 to user: Cannot 'detach_volume' instance 047c609b-8920-48da-a883-8ecb7c6214e9 while it is in vm_state rescued {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:13:36.687423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-297f35ea-8789-4cc6-8f96-18c7e974a29d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments/6e06cdae-616c-488a-a554-3c07c58666ac" status: 409 len: 152 microversion: 2.1 time: 0.108912 Jul 25 19:13:36.687423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 412/796] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:13:36 2022] DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments/6e06cdae-616c-488a-a554-3c07c58666ac => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 19:13:36.693477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:36.694108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:36.700339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.700712 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.701528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.701975 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.742451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:36.751234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b3f2ac1f-ce61-4ef1-8f0c-bf059b81fdbe tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.178853 Jul 25 19:13:36.751825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 385/797] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:36 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:36.921230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7c332a39-989c-42b3-a2d0-79f2c8f44dd6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/action" status: 202 len: 0 microversion: 2.1 time: 0.231756 Jul 25 19:13:36.921859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 413/798] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:13:36 2022] POST /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:13:36.930385 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:36.931006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:36.937031 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.937469 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:36.938230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:36.938687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:37.080827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:37.090301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0852b9a9-1619-4bc6-9d30-2aca9dfa893c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1723 microversion: 2.1 time: 0.163845 Jul 25 19:13:37.091181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 386/799] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:36 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:37.775012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:37.775809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:37.782710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:37.783792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:37.784599 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:37.785143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:37.957810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:37.966267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-19da267b-4b78-49cc-864a-9456603c3ff0 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.197199 Jul 25 19:13:37.966884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 414/800] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:37 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:37.998157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-d276c80a-26e7-470b-802b-5a77dd04c2f8 req-5d70dcfb-33de-46e8-8637-a39dba35e6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "name": "network-vif-plugged", "status": "completed", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:38.010450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d276c80a-26e7-470b-802b-5a77dd04c2f8 req-5d70dcfb-33de-46e8-8637-a39dba35e6c9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:38.010888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d276c80a-26e7-470b-802b-5a77dd04c2f8 req-5d70dcfb-33de-46e8-8637-a39dba35e6c9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:38.023391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-d276c80a-26e7-470b-802b-5a77dd04c2f8 req-5d70dcfb-33de-46e8-8637-a39dba35e6c9 service nova] Creating event network-vif-plugged:917d51f6-d780-4f2f-b965-f032f1e24916 for instance 08be3488-9017-42d8-99ed-63e8fe344653 on hv-cinder-82002 Jul 25 19:13:38.029183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-d276c80a-26e7-470b-802b-5a77dd04c2f8 req-5d70dcfb-33de-46e8-8637-a39dba35e6c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Jul 25 19:13:38.029883 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 387/801] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:13:38.113943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:38.114798 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:38.121672 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:38.122125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:38.122923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:38.123366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:38.265339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:38.274192 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d227efa6-84cf-4d93-b7a7-7b3d6d04fde5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1723 microversion: 2.1 time: 0.164987 Jul 25 19:13:38.274797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 415/802] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:38 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:38.989543 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:38.990451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:38.996866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:38.997306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:38.998073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:38.998793 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:39.165257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:39.172867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ed52a34e-fe55-4d80-99c5-b854e21bb3fb tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.188337 Jul 25 19:13:39.173411 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 388/803] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:38 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:39.296690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:39.297236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:39.304694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:39.305147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:39.305924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:39.306451 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:39.470568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:39.479702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3f117d3c-b510-457a-a819-6fc3e52f9e52 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1723 microversion: 2.1 time: 0.186900 Jul 25 19:13:39.480997 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 416/804] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:39 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:40.195130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:40.195728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:40.202456 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:40.203067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:40.203695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:40.204134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:40.342267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:40.350839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1ecf5b7d-3dad-49fa-9df1-b13807e21d6e tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.159602 Jul 25 19:13:40.351603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 389/805] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:40 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:40.502717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:40.503329 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:40.512799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:40.513581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:40.515037 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:40.515806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:40.655534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:40.664642 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1d3610d0-81de-4dd3-a14d-d37b1a4c350b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1723 microversion: 2.1 time: 0.166172 Jul 25 19:13:40.665226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 417/806] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:40 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:41.372074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:41.372694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:41.380260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:41.380695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:41.381447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:41.381871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:41.531614 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:41.541040 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1175d5d2-e38d-4c29-8d77-6c98de3da07f tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.172753 Jul 25 19:13:41.541621 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 390/807] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:41 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:41.686925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:41.687692 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:41.694772 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:41.695161 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:41.695932 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:41.696366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:41.837135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:41.846350 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-22beee21-c942-40ea-bd1c-df58e77fe772 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1729 microversion: 2.1 time: 0.162558 Jul 25 19:13:41.847003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 418/808] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:41 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:41.867353 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:41.867850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:41.874281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:41.874784 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:41.875552 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:41.875981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:41.954449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3541deef-0796-4433-a582-a2c46ddfb2b1 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090996 Jul 25 19:13:41.955657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 391/809] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:13:41 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:13:42.562935 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:42.565168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:42.575412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:42.575854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:42.576633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:42.577062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:42.726730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:42.735170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-227395cc-f2dc-44f1-908d-4e54e6a13061 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1258 microversion: 2.1 time: 0.176036 Jul 25 19:13:42.735757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 419/810] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:42 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:43.115698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-d028d4ea-f3c7-430b-acc6-2d99f4d642d6 req-ec09cd6a-a3f8-43a7-8f74-8f7400c5807b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047c609b-8920-48da-a883-8ecb7c6214e9", "tag": "2e704b22-3b93-4105-9a08-ff7d4aa61557"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:43.125665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d028d4ea-f3c7-430b-acc6-2d99f4d642d6 req-ec09cd6a-a3f8-43a7-8f74-8f7400c5807b service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:43.126113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-d028d4ea-f3c7-430b-acc6-2d99f4d642d6 req-ec09cd6a-a3f8-43a7-8f74-8f7400c5807b service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:43.145921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-d028d4ea-f3c7-430b-acc6-2d99f4d642d6 req-ec09cd6a-a3f8-43a7-8f74-8f7400c5807b service nova] Creating event network-changed:2e704b22-3b93-4105-9a08-ff7d4aa61557 for instance 047c609b-8920-48da-a883-8ecb7c6214e9 on hv-cinder-82002 Jul 25 19:13:43.151159 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-d028d4ea-f3c7-430b-acc6-2d99f4d642d6 req-ec09cd6a-a3f8-43a7-8f74-8f7400c5807b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109833 Jul 25 19:13:43.152061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 392/811] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:13:43.759722 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:43.761107 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:43.770562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:43.771329 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:43.772335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:43.773114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:44.047103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:44.053458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:44.061059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f4bbe30d-0e25-4cb4-9413-e39bd94df58c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1441 microversion: 2.1 time: 0.305415 Jul 25 19:13:44.061674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 420/812] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:43 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1441 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:13:44.098067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:13:44.098725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:13:44.106080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:44.108999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:44.111529 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:44.112807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:44.299562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:13:44.307802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6d23452e-6e7d-4d26-9f2c-83f1eb16a507 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1441 microversion: 2.1 time: 0.216429 Jul 25 19:13:44.309430 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 393/813] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:13:44 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1441 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:13:45.171681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-ca311706-01f0-4505-b97e-61c3c361dafe req-d526c779-3756-4993-a292-615c75818662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047c609b-8920-48da-a883-8ecb7c6214e9", "tag": "2e704b22-3b93-4105-9a08-ff7d4aa61557"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:45.177937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=66 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:45.184511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-ca311706-01f0-4505-b97e-61c3c361dafe req-d526c779-3756-4993-a292-615c75818662 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:45.184947 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-ca311706-01f0-4505-b97e-61c3c361dafe req-d526c779-3756-4993-a292-615c75818662 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:45.196844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-ca311706-01f0-4505-b97e-61c3c361dafe req-d526c779-3756-4993-a292-615c75818662 service nova] Creating event network-changed:2e704b22-3b93-4105-9a08-ff7d4aa61557 for instance 047c609b-8920-48da-a883-8ecb7c6214e9 on hv-cinder-82002 Jul 25 19:13:45.202407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-ca311706-01f0-4505-b97e-61c3c361dafe req-d526c779-3756-4993-a292-615c75818662 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035178 Jul 25 19:13:45.203011 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 421/814] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:13:47.234702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-f4ed3924-867d-4950-9da4-68c10ae95236 req-77ffdc95-d01b-40b7-bb97-035c9d7eaffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:13:47.245340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-f4ed3924-867d-4950-9da4-68c10ae95236 req-77ffdc95-d01b-40b7-bb97-035c9d7eaffa service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:13:47.246792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-f4ed3924-867d-4950-9da4-68c10ae95236 req-77ffdc95-d01b-40b7-bb97-035c9d7eaffa service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:13:47.258547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-f4ed3924-867d-4950-9da4-68c10ae95236 req-77ffdc95-d01b-40b7-bb97-035c9d7eaffa service nova] Creating event network-changed:917d51f6-d780-4f2f-b965-f032f1e24916 for instance 08be3488-9017-42d8-99ed-63e8fe344653 on hv-cinder-82002 Jul 25 19:13:47.263693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-f4ed3924-867d-4950-9da4-68c10ae95236 req-77ffdc95-d01b-40b7-bb97-035c9d7eaffa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Jul 25 19:13:47.264290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 394/815] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:14:18.681766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:18.682420 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:18.689336 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:18.689781 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:18.690617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:18.691603 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:18.775069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lazy-loading 'services' on Instance uuid 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:14:19.043601 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3d5ea0ee-1ea8-473f-a314-83ce7eada251 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-volume_attachments/9ec98785-e964-430d-a552-cb62e869458e" status: 202 len: 0 microversion: 2.1 time: 0.368021 Jul 25 19:14:19.044186 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 422/816] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:14:18 2022] DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-volume_attachments/9ec98785-e964-430d-a552-cb62e869458e => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:14:21.235006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=29 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:21.235751 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=90 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:21.240598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-25b441c4-82db-431a-a360-df2cb3b706ce tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:14:21.246859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-25b441c4-82db-431a-a360-df2cb3b706ce tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:21.250914 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-25b441c4-82db-431a-a360-df2cb3b706ce tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:21.313741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-25b441c4-82db-431a-a360-df2cb3b706ce tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Going to try to stop instance {{(pid=125167) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 19:14:21.521582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-25b441c4-82db-431a-a360-df2cb3b706ce tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action" status: 202 len: 0 microversion: 2.1 time: 0.288065 Jul 25 19:14:21.522197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 395/817] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:14:21 2022] POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:14:21.531261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:21.532059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:21.540147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:21.540602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:21.541378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:21.541809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:21.679226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:21.686788 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-17ccaf5a-fa04-4384-a536-dbea380c943e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.159662 Jul 25 19:14:21.687340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 423/818] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:21 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:22.709143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:22.709859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:22.716047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:22.716478 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:22.717229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:22.717656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:22.855429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:22.863062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5afda9ea-76b9-40b5-abec-90227c195e9c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.158607 Jul 25 19:14:22.863627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 396/819] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:22 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:23.884476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:23.885130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:23.891227 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:23.891667 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:23.892419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:23.892848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:24.023410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:24.031084 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2f5dcc5a-63a6-44a9-a37f-843762785c9e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.150434 Jul 25 19:14:24.031653 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 424/820] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:23 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:25.054602 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:25.055241 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:25.061720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:25.062169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:25.062965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:25.063401 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:25.202224 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:25.211157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4e23e758-8aea-42a3-9053-db121e268488 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.161239 Jul 25 19:14:25.211742 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 397/821] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:25 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:26.233479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:26.234120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:26.241485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:26.242026 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:26.242860 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:26.243308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:26.382160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:26.389651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-28101848-8610-43aa-a68a-ab32259c3c57 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.160205 Jul 25 19:14:26.390215 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 425/822] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:26 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:27.411818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:27.412447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:27.419157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:27.419598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:27.420380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:27.420800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:27.555660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:27.563220 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c818c3d4-b245-4de3-9c9d-fb7a1cea84f1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.156140 Jul 25 19:14:27.563871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 398/823] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:27 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:28.584327 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:28.584968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:28.591400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:28.591846 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:28.592722 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:28.593153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:28.726440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:28.733837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8b3e0d6a-62f3-4371-a064-5771ae21cee8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.153587 Jul 25 19:14:28.734415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 426/824] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:28 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:29.891835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:29.892453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:29.898658 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:29.899109 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:29.899894 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:29.900319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:30.040059 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:30.047610 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4e91c993-bd51-42b7-9b68-7b0839cab55e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.295796 Jul 25 19:14:30.048180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 399/825] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:29 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:31.070783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:31.071386 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:31.077841 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:31.078278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:31.079094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:31.079488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:31.218629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:31.226716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-961c6a07-e645-4e74-b090-c7b77b16dff8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.160164 Jul 25 19:14:31.227288 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 427/826] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:31 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:32.249190 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:32.249880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:32.257480 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:32.257916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:32.258716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:32.259145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:32.397279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:32.404913 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-20fcce3b-8448-4a1a-bf15-4418ce90adda tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.159756 Jul 25 19:14:32.405485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 400/827] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:32 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:33.427050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:33.427617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:33.434467 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:33.434913 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:33.435681 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:33.436113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:33.571622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:33.579241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-21ea7a4d-2774-4c06-bd52-50c3c0eea7d3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.156427 Jul 25 19:14:33.579816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 428/828] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:33 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:34.600912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:34.601897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:34.608502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:34.608948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:34.609702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:34.610135 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:34.749936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:34.758236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3169e3e7-8538-4c0c-8e08-be9662a1c9d0 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.161224 Jul 25 19:14:34.758836 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 401/829] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:34 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:35.781582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:35.782247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:35.789632 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:35.790082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:35.790899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:35.791334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:35.920250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:35.928285 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8d4fc4ae-cf04-4eb1-a798-22bd2624a576 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.150584 Jul 25 19:14:35.928855 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 429/830] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:35 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:36.949564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:36.950196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:36.957623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:36.958100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:36.958997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:36.959441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:37.092656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:37.101357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1a9ea69a-1018-46ee-9709-da7070ee595a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1675 microversion: 2.1 time: 0.155658 Jul 25 19:14:37.101933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 402/831] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:36 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:38.123576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:38.124175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:38.131269 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:38.131783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:38.132733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:38.133167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:38.270511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:38.278157 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b8046834-a42d-418b-8d7a-ac013a54d6b2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1652 microversion: 2.1 time: 0.158780 Jul 25 19:14:38.278758 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 430/832] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:38 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:38.298736 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8314b1b6-f605-4663-a4cc-f8fed224b3ae tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:14:38.305421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8314b1b6-f605-4663-a4cc-f8fed224b3ae tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:38.305862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8314b1b6-f605-4663-a4cc-f8fed224b3ae tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:38.328184 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8314b1b6-f605-4663-a4cc-f8fed224b3ae tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Going to try to start instance {{(pid=125167) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 19:14:38.576717 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8314b1b6-f605-4663-a4cc-f8fed224b3ae tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action" status: 202 len: 0 microversion: 2.1 time: 0.281652 Jul 25 19:14:38.577340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 403/833] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:14:38 2022] POST /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:14:38.589963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:38.591089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:38.601304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:38.602090 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:38.603483 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:38.604241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:38.764112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:38.772103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dd7b7536-9953-445d-8e2a-3a1817a2b6ed tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1661 microversion: 2.1 time: 0.189317 Jul 25 19:14:38.773592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 431/834] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:38 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1661 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:39.796249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:39.796937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:39.804394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:39.804840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:39.805784 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:39.806133 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:39.947599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:39.955163 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-300801ba-56fa-4066-8a67-334fe554d71c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1661 microversion: 2.1 time: 0.163524 Jul 25 19:14:39.959017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 404/835] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:39 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:14:40.977806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:14:40.978437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:14:40.985117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:40.985564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:40.986462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:14:40.986901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:14:41.127500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:14:41.135675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fd1bedb7-7f71-4e0a-a203-45584693849d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1665 microversion: 2.1 time: 0.161798 Jul 25 19:14:41.136250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 432/836] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:14:40 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:11.311078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:11.311673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:11.313880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=20 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:11.319142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:11.320204 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:11.320647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:11.321417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:11.321850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:11.351417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e989e3d3-77a9-427b-8bdb-1b1121649f4b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments/f12acf9d-e233-4506-ae37-fc66af6ccc9d" status: 200 len: 194 microversion: 2.20 time: 0.044332 Jul 25 19:15:11.353393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 405/837] 10.222.0.17 () {60 vars in 1454 bytes} [Mon Jul 25 19:15:11 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments/f12acf9d-e233-4506-ae37-fc66af6ccc9d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:15:11.421205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:11.421758 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:11.423818 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=23 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:11.424597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:11.429399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:11.429849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:11.430651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:11.431677 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:11.513502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lazy-loading 'services' on Instance uuid 455a6d7b-3a62-47e8-8eca-526bc28307de {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:15:11.789048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bca57f7d-5f8d-40be-baae-fcb76e74b818 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments/f12acf9d-e233-4506-ae37-fc66af6ccc9d" status: 202 len: 0 microversion: 2.20 time: 0.371837 Jul 25 19:15:11.789866 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 433/838] 10.222.0.17 () {60 vars in 1457 bytes} [Mon Jul 25 19:15:11 2022] DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments/f12acf9d-e233-4506-ae37-fc66af6ccc9d => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:15:11.799680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:11.802133 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:11.809598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:11.810100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:11.810919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:11.811359 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:11.842027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2d020ec4-e05f-4799-b8ce-f30ed861871c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047018 Jul 25 19:15:11.842630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 406/839] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Jul 25 19:15:11 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:15:12.856143 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:12.858508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:12.867408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:12.867908 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:12.868714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:12.869120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:12.900801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-341c78e5-0735-416f-b2bf-6a599fa5416e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049578 Jul 25 19:15:12.901375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 434/840] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Jul 25 19:15:12 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:15:13.914179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:13.916518 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:13.924016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:13.924462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:13.925384 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:13.925664 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:13.957424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-213b005a-d6d3-4a23-b5c0-641438a67664 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047184 Jul 25 19:15:13.957993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 407/841] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Jul 25 19:15:13 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:14.024243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:14.024880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:14.031378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:14.031823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:14.032593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:14.033723 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:14.059256 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:15:14.448904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ce26488c-3f0e-4fac-9b9a-8edbac63e536 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 204 len: 0 microversion: 2.20 time: 0.428264 Jul 25 19:15:14.449481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 435/842] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Jul 25 19:15:14 2022] DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 19:15:14.458754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:14.459380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:14.465814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:14.468113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:14.468113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:14.468113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:14.604642 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:14.612789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:14.614287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:14.615467 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-df01ca40-5554-42e0-8a12-654f0c683a45 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.161611 Jul 25 19:15:14.616022 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 408/843] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:14 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:15.640426 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:15.641120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:15.648262 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:15.648715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:15.649494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:15.649936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:15.836121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:15.844527 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:15.846720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:15.847916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-118c3d23-47f1-45bc-b702-67164b14634d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.211931 Jul 25 19:15:15.848484 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 436/844] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:15 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:16.871390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:16.872283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:16.879469 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:16.879915 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:16.880688 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:16.881123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:17.018229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:17.026658 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:17.028184 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:17.029339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5db6e802-9190-43cd-a3df-175bf300a6e3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1725 microversion: 2.20 time: 0.161955 Jul 25 19:15:17.029894 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 409/845] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:16 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:18.054240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:18.059589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:18.062057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:18.062586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:18.063367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:18.064205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:18.150762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:18.171017 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:18.172694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:18.174636 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-76d45cfa-2827-48ec-b0ae-fe5e62c94283 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1657 microversion: 2.20 time: 0.124320 Jul 25 19:15:18.175301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 437/846] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:18 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1657 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:18.249202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-00b1e52d-4f23-4c19-84d1-bf04cffe0ada req-fc6cde5f-56d5-44ef-8c84-d698e26c3971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455a6d7b-3a62-47e8-8eca-526bc28307de", "name": "network-vif-deleted", "tag": "e40ea0fc-afa9-4060-9acf-75154697423d"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:18.266301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-00b1e52d-4f23-4c19-84d1-bf04cffe0ada req-fc6cde5f-56d5-44ef-8c84-d698e26c3971 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:18.267906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-00b1e52d-4f23-4c19-84d1-bf04cffe0ada req-fc6cde5f-56d5-44ef-8c84-d698e26c3971 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:18.281178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-00b1e52d-4f23-4c19-84d1-bf04cffe0ada req-fc6cde5f-56d5-44ef-8c84-d698e26c3971 service nova] Creating event network-vif-deleted:e40ea0fc-afa9-4060-9acf-75154697423d for instance 455a6d7b-3a62-47e8-8eca-526bc28307de on hv-cinder-82002 Jul 25 19:15:18.286696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-00b1e52d-4f23-4c19-84d1-bf04cffe0ada req-fc6cde5f-56d5-44ef-8c84-d698e26c3971 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044281 Jul 25 19:15:18.287662 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 410/847] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:19.199754 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:19.200367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:19.208087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:19.208604 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:19.216046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:19.216533 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:19.252200 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:19.252978 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:19.253124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lazy-loading 'fault' on Instance uuid 455a6d7b-3a62-47e8-8eca-526bc28307de {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:15:19.305705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:19.316045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:19.318885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:19.321298 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0dabac91-655f-40b6-881c-fcd0076a480e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 200 len: 1372 microversion: 2.20 time: 0.125931 Jul 25 19:15:19.323029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 438/848] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:19 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:20.346270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:20.347111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:20.354092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:20.354558 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:20.355332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:20.355750 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:20.371196 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] HTTP exception thrown: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Request method failure captured: Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de HTTP/1.1 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk9gOYZ_mCIxXMCOP3QV5r4F_qttyP-qXdcK8jaV1TLRcsmzpGG-RGIMIq_H5yNNz6eXjFVNialntmqHw1lE1iziuYG1DBTu73NBglFIkQf7fxKHaI5LdxUgNyUbDzvNfEClMemJqSsdwzLZ3rw4jO0lycUCB6sSYHId2XVeJa9eC0 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:15:20.373146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2de35c4252b4a6fa55eb7e5d59e06cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: c99e02a845184f0aa206ba9f209ae4ef Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:15:20.374811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '455a6d7b-3a62-47e8-8eca-526bc28307de'} Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:15:20.375644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:15:20.377582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:15:20.389670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Returning 404 to user: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:15:20.389670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-18c33494-707e-4fd6-8bdf-f933b76243d3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 404 len: 111 microversion: 2.20 time: 0.033112 Jul 25 19:15:20.389670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 411/849] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:20 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:15:20.389953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f7bb3c71-ae5b-42ed-97a5-ac2d9cdac489 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '.version_select at 0x7fd8e5a35790>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:20.501818 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f7bb3c71-ae5b-42ed-97a5-ac2d9cdac489 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618047512" status: 204 len: 0 microversion: 2.20 time: 0.121407 Jul 25 19:15:20.502352 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 439/850] 10.222.0.17 () {60 vars in 1262 bytes} [Mon Jul 25 19:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618047512 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 19:15:21.411076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-719387df-a652-4dfc-9de7-09f73a7fea8d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'create', calling method: .version_select at 0x7fd8ea2cb040>, body: {"keypair": {"name": "tempest-keypair-1562545289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCooTDDC8ToKfLJl9Sgy1OTx90GuTaPaG3SPeDC5AxWlHFV8UyGksjXbeDQ/+DmbI4GYFeoOfWlPqVkl/qughN9NAo8IJAvMio1Fa2MdEIS/Zi296eGawWxfjexKWsIitg=="}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:21.432457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-719387df-a652-4dfc-9de7-09f73a7fea8d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:15:21.436360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-719387df-a652-4dfc-9de7-09f73a7fea8d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for user c99e02a845184f0aa206ba9f209ae4ef and project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:15:21.591104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-719387df-a652-4dfc-9de7-09f73a7fea8d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.186739 Jul 25 19:15:21.591646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 412/851] 10.222.0.17 () {62 vars in 1200 bytes} [Mon Jul 25 19:15:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 19:15:24.143427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1234943584", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cdac28d-1b45-4945-96b5-e0fd0c76cca8"}], "security_groups": [{"name": "tempest-securitygroup--2081424217"}], "key_name": "tempest-keypair-1562545289", "user_data": "}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:24.252694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] validate_networks() for [('0cdac28d-1b45-4945-96b5-e0fd0c76cca8', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:15:24.712663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:15:24.713082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:15:24.713548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:15:24.713952 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:15:24.714387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:15:24.723455 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:24.723904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:24.724728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:24.725162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:24.742421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:15:24.746650 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Getting quotas for user c99e02a845184f0aa206ba9f209ae4ef and project c2de35c4252b4a6fa55eb7e5d59e06cf. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:15:24.758699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:15:24.760964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:15:24.906097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ad113cc6-ffb1-4796-b8c8-584b8f3a18e7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.768302 Jul 25 19:15:24.906783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 440/852] 10.222.0.17 () {62 vars in 1188 bytes} [Mon Jul 25 19:15:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 19:15:24.918893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-85e2b996-68e5-48f4-b1e8-583498294389 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:24.919536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-85e2b996-68e5-48f4-b1e8-583498294389 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:24.981048 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-85e2b996-68e5-48f4-b1e8-583498294389 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:24.995446 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-85e2b996-68e5-48f4-b1e8-583498294389 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:24.997285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-85e2b996-68e5-48f4-b1e8-583498294389 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:24.998395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-85e2b996-68e5-48f4-b1e8-583498294389 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1282 microversion: 2.20 time: 0.084132 Jul 25 19:15:24.998948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 413/853] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:24 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:26.022858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:26.023555 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:26.029968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:26.031789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:26.031789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:26.031789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:26.246584 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:26.255580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:26.257129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:26.258227 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-aa378e15-5dd3-4f1e-874a-630fc07c12a1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1286 microversion: 2.20 time: 0.239893 Jul 25 19:15:26.258823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 441/854] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:26 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1286 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:27.111625 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:27.115032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:27.118827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:27.119271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:27.120033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:27.120511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:27.281235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:27.281996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:27.289559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:27.290085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:27.290962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:27.291468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:27.364420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'services' on Instance uuid 047c609b-8920-48da-a883-8ecb7c6214e9 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:15:27.378733 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:27.386759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:27.388362 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:27.389705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ff39ee54-f583-4314-8e0b-71ce64375dd1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1342 microversion: 2.20 time: 0.112498 Jul 25 19:15:27.390384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 442/855] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:27 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1342 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:15:27.656785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-58bb6046-2858-44b6-a506-dda1c93b418d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments/6e06cdae-616c-488a-a554-3c07c58666ac" status: 202 len: 0 microversion: 2.1 time: 0.549610 Jul 25 19:15:27.661667 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 414/856] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:15:27 2022] DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments/6e06cdae-616c-488a-a554-3c07c58666ac => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:15:27.667187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:27.670060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:27.676340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:27.676869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:27.677717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:27.678157 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:27.711435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2b091451-6c36-4b1f-aa00-b8c124263189 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048168 Jul 25 19:15:27.712000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 443/857] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:15:27 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:28.417302 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:28.418805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:28.431523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:28.431523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:28.431523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:28.431523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:28.572079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:28.581094 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:28.582618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:28.583754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a831dd80-1663-4407-8418-07ec0a18349f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.172879 Jul 25 19:15:28.584579 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 415/858] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:28 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:28.725039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:28.727168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:28.733711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:28.734174 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:28.734971 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:28.736184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:28.766730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-722dfbfc-7a0c-481b-8c76-112ed9cd1bce tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Jul 25 19:15:28.767809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 444/859] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:15:28 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:29.244577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-8dbd08ff-9efe-4d12-8f8b-e475587c8aa5 req-63bc1287-4bf9-4f4d-92e5-99e3724b1a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:29.257819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-8dbd08ff-9efe-4d12-8f8b-e475587c8aa5 req-63bc1287-4bf9-4f4d-92e5-99e3724b1a30 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.258255 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-8dbd08ff-9efe-4d12-8f8b-e475587c8aa5 req-63bc1287-4bf9-4f4d-92e5-99e3724b1a30 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.273863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-8dbd08ff-9efe-4d12-8f8b-e475587c8aa5 req-63bc1287-4bf9-4f4d-92e5-99e3724b1a30 service nova] Creating event network-changed:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:15:29.279032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-8dbd08ff-9efe-4d12-8f8b-e475587c8aa5 req-63bc1287-4bf9-4f4d-92e5-99e3724b1a30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104164 Jul 25 19:15:29.279877 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 416/860] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:29.608335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:29.609078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:29.615917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.616719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.617440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.617869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.780871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:29.783637 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:29.790048 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.790553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.791335 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.792493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.817263 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:29.824679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:29.825649 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a02df170-30b0-4ffc-86a7-f10dbafcc2c5 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049667 Jul 25 19:15:29.826513 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 417/861] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:15:29 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 19:15:29.832177 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:29.832177 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6dce33fa-d59b-478f-97cb-ad95e1df43c9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.224075 Jul 25 19:15:29.832177 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 445/862] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:29 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:29.931854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:29.932349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:29.939946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.940612 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.941479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:29.941916 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:29.976562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:15:30.089030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:30.285699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bc063479-8aa2-45f6-b4bf-84c7a2a19c0b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 204 len: 0 microversion: 2.1 time: 0.357540 Jul 25 19:15:30.286404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 446/863] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:15:29 2022] DELETE /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:15:30.294622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:30.297769 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:30.301903 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:30.302373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:30.303145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:30.303579 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:30.436501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:30.445076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-81416389-deeb-4903-97d5-d6e34a6660a0 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1689 microversion: 2.1 time: 0.154354 Jul 25 19:15:30.445645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 418/864] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:30 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:30.864511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:30.865210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:30.872747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:30.873193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:30.873967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:30.874435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:31.020663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:31.029419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:31.030986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:31.032122 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0552b012-5a53-404d-9889-5597ce928b68 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.172432 Jul 25 19:15:31.032678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 447/865] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:30 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:31.467552 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:31.468175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:31.474934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:31.475371 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:31.476126 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:31.476551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:31.609327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:31.617308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ac3225d4-df75-4595-a065-95d56464d8b6 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1689 microversion: 2.1 time: 0.153668 Jul 25 19:15:31.617868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 419/866] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:31 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:32.055294 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:32.055931 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:32.062403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:32.062848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:32.064212 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:32.064638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:32.208714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:32.216886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:32.218435 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:32.219711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a730e4bb-66ac-4bea-a4e2-3499e96bc7a3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.168318 Jul 25 19:15:32.220137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 448/867] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:32 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:15:32.639339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:32.639890 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:32.647137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:32.647587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:32.648355 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:32.648790 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:32.781340 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:32.789718 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-186f4118-9f31-4d49-9455-34d7c1f0d5c8 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1689 microversion: 2.1 time: 0.154350 Jul 25 19:15:32.790307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 420/868] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:32 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:33.242487 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:33.243025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:33.249741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:33.250191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:33.251575 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:33.252011 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:33.382602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:33.390589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:33.392846 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:33.393968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ee8d3568-ac03-4717-a60a-775bb024d497 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.155538 Jul 25 19:15:33.394555 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 449/869] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:33 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:33.811283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:33.811955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:33.819064 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:33.819510 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:33.820267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:33.820703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:33.957618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:33.965034 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-eb1dc1bd-8f70-4fc6-bc7e-90fdac84d256 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1689 microversion: 2.1 time: 0.157754 Jul 25 19:15:33.965597 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 421/870] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:33 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:34.432877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:34.433491 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:34.440199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:34.440648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:34.441434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:34.441871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:34.577593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:34.586836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:34.589108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:34.590403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-58c14c87-2fe4-4627-a40f-6db0ac7338e9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.161556 Jul 25 19:15:34.591169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 450/871] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:34 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:34.987632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:34.988338 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:34.991690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:34.995249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:34.995685 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:34.996716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:34.997144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:35.147000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:35.163288 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0214ff4a-f45d-4000-b742-f4ffacf0212d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1689 microversion: 2.1 time: 0.179232 Jul 25 19:15:35.164100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 422/872] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:34 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:35.615343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:35.616062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:35.618002 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:35.618805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:35.624272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:35.624711 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:35.625483 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:35.626090 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:35.769839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:35.778219 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:35.779778 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:35.780928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-138e5fce-a50a-4882-bb87-4bf5627e6b40 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.169616 Jul 25 19:15:35.781468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 451/873] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:35 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:36.186120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:36.186800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:36.200392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:36.201844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:36.201844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:36.202454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:36.340892 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:36.349149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-badc2444-1bdd-43ec-a708-2b243ecc913a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1689 microversion: 2.1 time: 0.166840 Jul 25 19:15:36.350372 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 423/874] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:36 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:36.704598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-c4a51ed1-356a-4666-9ad3-0d956099705a req-6f349a42-bf29-46dd-8821-2bfef8c80429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "name": "network-vif-plugged", "status": "completed", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:36.718558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-c4a51ed1-356a-4666-9ad3-0d956099705a req-6f349a42-bf29-46dd-8821-2bfef8c80429 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:36.718558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-c4a51ed1-356a-4666-9ad3-0d956099705a req-6f349a42-bf29-46dd-8821-2bfef8c80429 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:36.727414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-c4a51ed1-356a-4666-9ad3-0d956099705a req-6f349a42-bf29-46dd-8821-2bfef8c80429 service nova] Creating event network-vif-plugged:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:15:36.732340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-c4a51ed1-356a-4666-9ad3-0d956099705a req-6f349a42-bf29-46dd-8821-2bfef8c80429 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032060 Jul 25 19:15:36.732930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 452/875] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:36.804790 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:36.805503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:36.811976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:36.812541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:36.814163 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:36.814629 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:36.970457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:36.974027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:36.980533 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:36.982089 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:36.985785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2d3ba0ba-fde6-4ec3-8a78-b2a4b488d6e0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.182832 Jul 25 19:15:36.985785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 424/876] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:36 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:37.081336 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-35e3f4c7-e764-4047-90f5-52767db8753c req-e4a551f2-734e-4166-97dd-35a002f5089e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047c609b-8920-48da-a883-8ecb7c6214e9", "name": "network-vif-deleted", "tag": "2e704b22-3b93-4105-9a08-ff7d4aa61557"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:37.111349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-35e3f4c7-e764-4047-90f5-52767db8753c req-e4a551f2-734e-4166-97dd-35a002f5089e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:37.111349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-35e3f4c7-e764-4047-90f5-52767db8753c req-e4a551f2-734e-4166-97dd-35a002f5089e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:37.111349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-35e3f4c7-e764-4047-90f5-52767db8753c req-e4a551f2-734e-4166-97dd-35a002f5089e service nova] Creating event network-vif-deleted:2e704b22-3b93-4105-9a08-ff7d4aa61557 for instance 047c609b-8920-48da-a883-8ecb7c6214e9 on hv-cinder-82002 Jul 25 19:15:37.117488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-35e3f4c7-e764-4047-90f5-52767db8753c req-e4a551f2-734e-4166-97dd-35a002f5089e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042588 Jul 25 19:15:37.119301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 453/877] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:37.371645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:37.372280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:37.381541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:37.381541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:37.382213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:37.382680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:37.453153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:37.461420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8befb554-276f-4ec2-a5f4-9547398d24d2 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1330 microversion: 2.1 time: 0.093900 Jul 25 19:15:37.462236 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 425/878] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:37 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:38.008379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:38.009158 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:38.016891 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:38.017721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:38.018651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:38.019189 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:38.168251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:38.177699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:38.179234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:38.180343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5558dc6c-e729-4543-a1ba-fb00a56441f8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1408 microversion: 2.20 time: 0.176588 Jul 25 19:15:38.180897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 454/879] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:38 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:38.484624 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:38.485271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:38.494922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:38.494922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:38.494922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:38.494922 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:38.526577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:38.527025 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:38.527481 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'fault' on Instance uuid 047c609b-8920-48da-a883-8ecb7c6214e9 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:15:38.569044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:38.576771 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b47ada87-a845-4edb-92f3-d59b842af047 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 200 len: 1335 microversion: 2.1 time: 0.097363 Jul 25 19:15:38.577344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 426/880] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:38 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:39.205301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:39.206190 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:39.213185 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:39.213648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:39.214485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:39.215001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:39.357173 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:39.365731 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:39.367275 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:39.368436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-10de6a1f-a6c8-4db3-add3-d6c676c1a962 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1600 microversion: 2.20 time: 0.168107 Jul 25 19:15:39.369057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 455/881] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:15:39 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:15:39.393563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:39.394076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:39.400380 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:39.400826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:39.401733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:39.402181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:39.496647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-47be1624-dda2-4714-b9d3-d8628250a9e1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107451 Jul 25 19:15:39.497220 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 427/882] 10.222.0.17 () {60 vars in 1316 bytes} [Mon Jul 25 19:15:39 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:15:39.600477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:39.601097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: 047c609b-8920-48da-a883-8ecb7c6214e9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:39.607160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:39.607602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:39.608371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:39.609248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:39.623355 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] HTTP exception thrown: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 could not be found. Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Request method failure captured: Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 HTTP/1.1 Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk6qrggI4ZdDZ3OljzMTvskbV_LrBAkfnST4XU-fpRTsNtG_FLto1q8CTbpeh4sh1JrPNS-rCyPw8VIidTfhG6Z7zd6g581q-F-CAMVpo-QrvhvSVGMCUcHuveYvtEA543E-TYXD6laTWuEeEs15TXe4KklGT0yFfbFtxM_8cV2CSY Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:15:39.625014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08c6be8edb884214bae7a0abbf97dc16", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 7e3f168283ba4f159948830f396ae7cf Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 could not be found. Jul 25 19:15:39.627318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '047c609b-8920-48da-a883-8ecb7c6214e9'} Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 could not be found. Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:15:39.631494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 could not be found. Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 could not be found. Jul 25 19:15:39.632888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:39.634060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Returning 404 to user: Instance 047c609b-8920-48da-a883-8ecb7c6214e9 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:15:39.634060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-40005882-28b5-4e89-8273-b1fa5375c369 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9" status: 404 len: 111 microversion: 2.1 time: 0.030735 Jul 25 19:15:39.634060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 456/883] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:39 2022] GET /compute/v2.1/servers/047c609b-8920-48da-a883-8ecb7c6214e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:15:39.639927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-01f136d0-f8af-4941-843b-d0eff3e0721b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '.version_select at 0x7fd8ea444160>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:39.785636 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-01f136d0-f8af-4941-843b-d0eff3e0721b tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111031312" status: 202 len: 0 microversion: 2.1 time: 0.149918 Jul 25 19:15:39.786370 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 428/884] 10.222.0.17 () {58 vars in 1221 bytes} [Mon Jul 25 19:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111031312 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:15:40.559528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-64d8e784-9e10-49b1-94ab-3f246a3faec7 req-f24cadf7-68ff-416c-b292-0a7b25d3c9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:40.569993 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-64d8e784-9e10-49b1-94ab-3f246a3faec7 req-f24cadf7-68ff-416c-b292-0a7b25d3c9cb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:40.570946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-64d8e784-9e10-49b1-94ab-3f246a3faec7 req-f24cadf7-68ff-416c-b292-0a7b25d3c9cb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:40.582731 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-64d8e784-9e10-49b1-94ab-3f246a3faec7 req-f24cadf7-68ff-416c-b292-0a7b25d3c9cb service nova] Creating event network-changed:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:15:40.587998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-64d8e784-9e10-49b1-94ab-3f246a3faec7 req-f24cadf7-68ff-416c-b292-0a7b25d3c9cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032056 Jul 25 19:15:40.588655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 457/885] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:43.232743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:43.233277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:43.236455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:43.242149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:43.242618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:43.243396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:43.243831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:43.271836 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:15:43.691576 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4d6f1880-64bc-4ab3-8901-ad98d9a9b848 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 204 len: 0 microversion: 2.1 time: 0.462387 Jul 25 19:15:43.692308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 429/886] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:15:43 2022] DELETE /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:15:43.701505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:43.702319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:43.704277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:43.709700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:43.710152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:43.710966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:43.711447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:43.856009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:43.864621 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-07e29901-5bcc-4b1d-8aff-44dd34e09e9a tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1509 microversion: 2.1 time: 0.167663 Jul 25 19:15:43.865104 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 458/887] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:43 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:15:44.893631 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:44.894433 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:44.901338 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:44.901818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:44.902616 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:44.903049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:45.149400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:45.161466 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-393d5eab-c6df-4b82-8f29-c97df2f63355 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1509 microversion: 2.1 time: 0.273495 Jul 25 19:15:45.162423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 430/888] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:44 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:45.632178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-c3e767c2-93dc-4125-a88e-e9d0d6f9d4c2 req-17e551fd-3c46-4675-9d9d-ae77b6a1b7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ff921d-92b0-4208-b109-9f6969a9b950", "name": "network-vif-deleted", "tag": "a30f1989-9491-4874-b4fd-962b93238fb5"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:45.646132 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-c3e767c2-93dc-4125-a88e-e9d0d6f9d4c2 req-17e551fd-3c46-4675-9d9d-ae77b6a1b7ee service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:45.646597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-c3e767c2-93dc-4125-a88e-e9d0d6f9d4c2 req-17e551fd-3c46-4675-9d9d-ae77b6a1b7ee service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:45.662476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-c3e767c2-93dc-4125-a88e-e9d0d6f9d4c2 req-17e551fd-3c46-4675-9d9d-ae77b6a1b7ee service nova] Creating event network-vif-deleted:a30f1989-9491-4874-b4fd-962b93238fb5 for instance a8ff921d-92b0-4208-b109-9f6969a9b950 on hv-cinder-82002 Jul 25 19:15:45.669167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-c3e767c2-93dc-4125-a88e-e9d0d6f9d4c2 req-17e551fd-3c46-4675-9d9d-ae77b6a1b7ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044708 Jul 25 19:15:45.670406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 459/889] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:46.182892 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:46.183505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:46.191659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:46.192106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:46.192887 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:46.193319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:46.242802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:46.243257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:46.243724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'fault' on Instance uuid a8ff921d-92b0-4208-b109-9f6969a9b950 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:15:46.300539 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:46.309668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e40d87ec-2471-45e1-bdfc-62c080b2c75c tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 200 len: 1312 microversion: 2.1 time: 0.130974 Jul 25 19:15:46.310255 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 431/890] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:46 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:47.335865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:47.336562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: a8ff921d-92b0-4208-b109-9f6969a9b950] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:47.344006 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:47.345223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:47.346083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:47.346568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:47.361188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] HTTP exception thrown: Instance a8ff921d-92b0-4208-b109-9f6969a9b950 could not be found. Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Request method failure captured: Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 HTTP/1.1 Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk6qrggI4ZdDZ3OljzMTvskbV_LrBAkfnST4XU-fpRTsNtG_FLto1q8CTbpeh4sh1JrPNS-rCyPw8VIidTfhG6Z7zd6g581q-F-CAMVpo-QrvhvSVGMCUcHuveYvtEA543E-TYXD6laTWuEeEs15TXe4KklGT0yFfbFtxM_8cV2CSY Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:15:47.362928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08c6be8edb884214bae7a0abbf97dc16", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 7e3f168283ba4f159948830f396ae7cf Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance a8ff921d-92b0-4208-b109-9f6969a9b950 could not be found. Jul 25 19:15:47.364419 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'a8ff921d-92b0-4208-b109-9f6969a9b950'} Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ff921d-92b0-4208-b109-9f6969a9b950 could not be found. Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:15:47.365146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ff921d-92b0-4208-b109-9f6969a9b950 could not be found. Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ff921d-92b0-4208-b109-9f6969a9b950 could not be found. Jul 25 19:15:47.366700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:47.368076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Returning 404 to user: Instance a8ff921d-92b0-4208-b109-9f6969a9b950 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:15:47.368076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-aa5d059b-16de-4d6f-b0d2-d89fe7680136 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950" status: 404 len: 111 microversion: 2.1 time: 0.032947 Jul 25 19:15:47.368076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 460/891] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:47 2022] GET /compute/v2.1/servers/a8ff921d-92b0-4208-b109-9f6969a9b950 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:15:47.373738 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:47.374231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:47.381069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:47.381503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:47.382255 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:47.382716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:47.409466 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:15:47.797378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7cdcb33a-9c3d-46e9-8d83-5003f8386c63 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 204 len: 0 microversion: 2.1 time: 0.427516 Jul 25 19:15:47.797978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 432/892] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:15:47 2022] DELETE /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:15:47.806481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:47.807178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:47.814095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:47.814577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:47.815367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:47.815903 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:47.959909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:47.967919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-684c85b0-c8ff-4530-9258-037a69702123 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.165609 Jul 25 19:15:47.968640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 461/893] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:47 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:48.991149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:48.991854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:48.998779 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:48.999229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:49.000003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:49.001071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:49.223213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:49.231152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b7347c95-bf83-40eb-92ce-8bca2d627bc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1521 microversion: 2.1 time: 0.244555 Jul 25 19:15:49.231720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 433/894] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:48 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:49.457290 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-aba237ff-6fef-4f04-a98e-45566f634735 req-ea7df0a7-a4ae-4bc6-920e-3343cdd7ef3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffab6ed-1699-49d7-bee1-73e045f1e868", "name": "network-vif-deleted", "tag": "58ad3790-244f-4d95-b9e7-422923ef19fa"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:15:49.467396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-aba237ff-6fef-4f04-a98e-45566f634735 req-ea7df0a7-a4ae-4bc6-920e-3343cdd7ef3a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:49.467830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-aba237ff-6fef-4f04-a98e-45566f634735 req-ea7df0a7-a4ae-4bc6-920e-3343cdd7ef3a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:49.479629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-aba237ff-6fef-4f04-a98e-45566f634735 req-ea7df0a7-a4ae-4bc6-920e-3343cdd7ef3a service nova] Creating event network-vif-deleted:58ad3790-244f-4d95-b9e7-422923ef19fa for instance bffab6ed-1699-49d7-bee1-73e045f1e868 on hv-cinder-82002 Jul 25 19:15:49.484460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-aba237ff-6fef-4f04-a98e-45566f634735 req-ea7df0a7-a4ae-4bc6-920e-3343cdd7ef3a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031815 Jul 25 19:15:49.485314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 462/895] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:15:50.262195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:50.262998 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:50.269952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:50.270440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:50.271213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:50.271650 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:50.304715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:50.305155 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:50.313490 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lazy-loading 'fault' on Instance uuid bffab6ed-1699-49d7-bee1-73e045f1e868 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:15:50.350830 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3f168283ba4f159948830f396ae7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c6be8edb884214bae7a0abbf97dc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:15:50.356879 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fed06fdd-8e10-478c-b674-afffa5a73fc7 tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 200 len: 1311 microversion: 2.1 time: 0.098483 Jul 25 19:15:50.357462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 434/896] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:50 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:15:51.380663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:15:51.381445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] [instance: bffab6ed-1699-49d7-bee1-73e045f1e868] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:15:51.387751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:51.388206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:51.388977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:15:51.389416 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:15:51.405811 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] HTTP exception thrown: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 could not be found. Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Request method failure captured: Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 HTTP/1.1 Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk6qrggI4ZdDZ3OljzMTvskbV_LrBAkfnST4XU-fpRTsNtG_FLto1q8CTbpeh4sh1JrPNS-rCyPw8VIidTfhG6Z7zd6g581q-F-CAMVpo-QrvhvSVGMCUcHuveYvtEA543E-TYXD6laTWuEeEs15TXe4KklGT0yFfbFtxM_8cV2CSY Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:15:51.408375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08c6be8edb884214bae7a0abbf97dc16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08c6be8edb884214bae7a0abbf97dc16", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 08c6be8edb884214bae7a0abbf97dc16 Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-838362749 Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 7e3f168283ba4f159948830f396ae7cf Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-838362749-project Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 could not be found. Jul 25 19:15:51.409759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'bffab6ed-1699-49d7-bee1-73e045f1e868'} Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 could not be found. Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:15:51.410567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 could not be found. Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 could not be found. Jul 25 19:15:51.412040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:15:51.413381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] Returning 404 to user: Instance bffab6ed-1699-49d7-bee1-73e045f1e868 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:15:51.413381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2c1974a5-90cd-4b6b-8526-4e20da85755d tempest-ServerRescueNegativeTestJSON-838362749 tempest-ServerRescueNegativeTestJSON-838362749-project] 10.222.0.17 "GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868" status: 404 len: 111 microversion: 2.1 time: 0.034211 Jul 25 19:15:51.413381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 463/897] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:15:51 2022] GET /compute/v2.1/servers/bffab6ed-1699-49d7-bee1-73e045f1e868 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:16:00.828827 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:00.829677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:00.833934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:00.841638 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:00.842245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:00.845373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:00.845373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:00.845373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:00.879748 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-499af769-78b8-4e81-8e83-91d9f42f586f tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052497 Jul 25 19:16:00.880342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 435/898] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:16:00 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:16:00.958894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:00.959456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:00.966147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:00.966672 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:00.967466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:00.967910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:00.976438 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=71 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:00.996332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:16:01.368721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-de1f00bd-5e76-47c0-90da-1f13a8772316 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 204 len: 0 microversion: 2.1 time: 0.414040 Jul 25 19:16:01.369312 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 464/899] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:16:00 2022] DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:16:01.386030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:01.386703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:01.393519 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:01.394062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:01.394936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:01.395468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:01.544246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:01.552449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0dca6121-8bd5-421a-92d5-f6a8f9d2a069 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1671 microversion: 2.1 time: 0.171940 Jul 25 19:16:01.553022 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 436/900] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:01 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:16:02.576069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:02.576768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:02.583247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:02.583699 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:02.584477 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:02.584906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:02.724687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:02.732208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0914031d-c7a0-46b3-a0d5-93990d2f0333 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1671 microversion: 2.1 time: 0.161566 Jul 25 19:16:02.732786 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 465/901] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:02 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:03.754484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:03.755102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:03.762275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:03.762754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:03.763522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:03.763957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:03.842353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-d7f2bec0-989b-4f5d-bfab-faa305737109 req-5d6addc8-a34e-4d9b-b0dd-90c0f84bf2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c66e632-dd5c-4eb5-89fb-ddfe319d4046", "name": "network-vif-deleted", "tag": "e4b23594-f162-4f7b-9587-c619dd49ac56"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:03.857014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d7f2bec0-989b-4f5d-bfab-faa305737109 req-5d6addc8-a34e-4d9b-b0dd-90c0f84bf2cb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:03.857492 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d7f2bec0-989b-4f5d-bfab-faa305737109 req-5d6addc8-a34e-4d9b-b0dd-90c0f84bf2cb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:03.857978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:03.876511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-356297ce-b72f-4ee6-b5c8-727aa2ea0b17 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 200 len: 1603 microversion: 2.1 time: 0.127110 Jul 25 19:16:03.877244 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 437/902] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:03 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 1603 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:03.878315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-d7f2bec0-989b-4f5d-bfab-faa305737109 req-5d6addc8-a34e-4d9b-b0dd-90c0f84bf2cb service nova] Creating event network-vif-deleted:e4b23594-f162-4f7b-9587-c619dd49ac56 for instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 on hv-cinder-82002 Jul 25 19:16:03.894505 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-d7f2bec0-989b-4f5d-bfab-faa305737109 req-5d6addc8-a34e-4d9b-b0dd-90c0f84bf2cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055451 Jul 25 19:16:03.895124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 466/903] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:04.901783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:04.902357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:04.909455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:04.909913 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:04.910735 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:04.911171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:04.927235 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] HTTP exception thrown: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Request method failure captured: Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 HTTP/1.1 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk4AbZuX7Q1zjRdT0jZiyndCKO5951qSJAXUv82_F9DfMsAC-gxhMzkz-RmvSMPJi_qaBXH7Pz2USW6piei_KvrTtr8vrDR5-YXHgQ-1vZLuIwJCb0ZRGR-jpZ4xanAkONNjGXqzGmhnk9Ea5cTV1J9nURP6puZM5gtSauVtjzLoZ8 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:16:04.947179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e929654eb2b4c1ca969174e94aa8de2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 592de777b94148b791e18bf898386f34 Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:16:04.949174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '4c66e632-dd5c-4eb5-89fb-ddfe319d4046'} Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:16:04.950003 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:16:04.952437 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:16:04.955067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Returning 404 to user: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:16:04.955067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6a9ccc4f-6a65-4531-b6e4-d416f9d9af3d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 404 len: 111 microversion: 2.1 time: 0.033488 Jul 25 19:16:04.955067 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 438/904] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:04 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:16:04.955476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-99766be7-783d-4f2d-a85e-19aa188c6039 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '.version_select at 0x7fd8e5bf5310>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:05.161666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-99766be7-783d-4f2d-a85e-19aa188c6039 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-710729291" status: 202 len: 0 microversion: 2.1 time: 0.212421 Jul 25 19:16:05.161666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 467/905] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Jul 25 19:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-710729291 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:16:06.033674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ac6ad76e-4540-46ca-9d40-20268804d32e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: .version_select at 0x7fd8ea3f3820>, body: {"keypair": {"name": "tempest-keypair-1242645006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdm8KngakbRBk7Vx4+s1LHKfUhDAHqAAA1jVaWN+kAroxJib20RMjIpxa0rvgVsGULLskhJgYQAI0w4tYUFbb2mOnXnIY/fome1W6pLgitGRrAuc/0uLRgdkVRoiDcp7w=="}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:06.052274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-ac6ad76e-4540-46ca-9d40-20268804d32e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:16:06.056576 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-ac6ad76e-4540-46ca-9d40-20268804d32e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for user 592de777b94148b791e18bf898386f34 and project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:16:06.150993 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ac6ad76e-4540-46ca-9d40-20268804d32e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122056 Jul 25 19:16:06.151858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 439/906] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:16:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:08.849913 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1064739593", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6572528-5d40-45d4-b911-d98d584260e1"}], "security_groups": [{"name": "tempest-securitygroup--1106546643"}], "key_name": "tempest-keypair-1242645006", "user_data": "}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:08.957673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] validate_networks() for [('d6572528-5d40-45d4-b911-d98d584260e1', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:16:09.494099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:16:09.494099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:16:09.494099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:16:09.494099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:16:09.494099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:16:09.494749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:09.494749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:09.494749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:09.494749 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:09.511280 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:16:09.515383 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Getting quotas for user 592de777b94148b791e18bf898386f34 and project 5e929654eb2b4c1ca969174e94aa8de2. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:16:09.526526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:16:09.528854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:16:09.656754 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9a1dcca8-4794-4146-87d7-48fe806ce30d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.811778 Jul 25 19:16:09.661394 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 468/907] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:16:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:16:09.670754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-cebdd194-f7ed-46a6-bfce-7fa39c175d00 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:09.672166 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-cebdd194-f7ed-46a6-bfce-7fa39c175d00 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:09.728701 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-cebdd194-f7ed-46a6-bfce-7fa39c175d00 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:09.736128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-cebdd194-f7ed-46a6-bfce-7fa39c175d00 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1238 microversion: 2.1 time: 0.071649 Jul 25 19:16:09.736699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 440/908] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:09 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:10.758087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-184719b6-e458-486c-bd5a-881a8d5aff45 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:10.758700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-184719b6-e458-486c-bd5a-881a8d5aff45 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:10.826765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-184719b6-e458-486c-bd5a-881a8d5aff45 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:10.834150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-184719b6-e458-486c-bd5a-881a8d5aff45 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1238 microversion: 2.1 time: 0.080526 Jul 25 19:16:10.834759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 469/909] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:10 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:11.858657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-879b3637-a318-4ec3-8a49-1df635cbf94a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:11.859970 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-879b3637-a318-4ec3-8a49-1df635cbf94a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:11.920122 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-879b3637-a318-4ec3-8a49-1df635cbf94a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:11.928996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-879b3637-a318-4ec3-8a49-1df635cbf94a tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1238 microversion: 2.1 time: 0.073055 Jul 25 19:16:11.928996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 441/910] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:11 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:12.232698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:16:12.233028 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:16:12.949406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8110813c-a4b1-4bb4-954a-4d199800a657 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:12.950208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8110813c-a4b1-4bb4-954a-4d199800a657 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:13.021653 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8110813c-a4b1-4bb4-954a-4d199800a657 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:13.034429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8110813c-a4b1-4bb4-954a-4d199800a657 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1238 microversion: 2.1 time: 0.088425 Jul 25 19:16:13.036388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 470/911] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:12 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:14.056939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:14.057642 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:14.064910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:14.065354 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:14.066128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:14.066593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:14.132315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:14.140078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-58af5b96-231f-4f1e-9d20-2f7689987402 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1242 microversion: 2.1 time: 0.086884 Jul 25 19:16:14.141367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 442/912] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:14 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:15.161602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:15.162228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:15.170687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:15.171406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:15.172311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:15.173164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:15.256541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:15.264347 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b2734818-2b76-424c-acef-be858885ae0c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1242 microversion: 2.1 time: 0.107013 Jul 25 19:16:15.264897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 471/913] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:15 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:16.290665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:16.291276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:16.299137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:16.299598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:16.301559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:16.302040 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:16.393378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:16.401483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fd4039d2-68f8-4209-9d99-594902adacd8 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1298 microversion: 2.1 time: 0.114820 Jul 25 19:16:16.402075 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 443/914] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:16 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:16:17.425829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:17.427443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:17.436229 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:17.437495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:17.438602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:17.439236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:17.594790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:17.608760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7161f67e-037a-416c-881d-8ec87071caf3 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.182305 Jul 25 19:16:17.608760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 472/915] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:17 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:18.583594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-8d6ade22-a90c-486d-b57f-2ba2a2ac897b req-d9ca61ee-9e90-4209-9e07-8135e3639e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cda365-54af-4db5-857e-91948f2d7503", "tag": "52683359-7607-4c5f-8e77-291378a6ff24"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:18.607903 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-8d6ade22-a90c-486d-b57f-2ba2a2ac897b req-d9ca61ee-9e90-4209-9e07-8135e3639e28 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:18.608348 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-8d6ade22-a90c-486d-b57f-2ba2a2ac897b req-d9ca61ee-9e90-4209-9e07-8135e3639e28 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:18.622089 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-8d6ade22-a90c-486d-b57f-2ba2a2ac897b req-d9ca61ee-9e90-4209-9e07-8135e3639e28 service nova] Creating event network-changed:52683359-7607-4c5f-8e77-291378a6ff24 for instance d8cda365-54af-4db5-857e-91948f2d7503 on hv-cinder-82002 Jul 25 19:16:18.626784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:18.631327 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:18.631781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-8d6ade22-a90c-486d-b57f-2ba2a2ac897b req-d9ca61ee-9e90-4209-9e07-8135e3639e28 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052500 Jul 25 19:16:18.631781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 444/916] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:18.631955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:18.637897 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:18.638607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:18.639587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:18.640279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:18.826928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:18.841104 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-46df3802-2e01-4ec1-9eb7-025cae59ad01 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.218987 Jul 25 19:16:18.842014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 473/917] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:18 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:19.870821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:19.875460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:19.878866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:19.879611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:19.880418 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:19.880851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:20.029387 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:20.044780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b718ae1a-5049-4071-bb64-92f0d8fc7865 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.178902 Jul 25 19:16:20.045527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 445/918] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:19 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:21.069563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:21.070237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:21.072504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:21.079406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:21.079851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:21.080635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:21.081054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:21.239332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:21.247574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-459f6fdd-83df-4330-b6be-a6c8feb02359 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.182098 Jul 25 19:16:21.248198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 474/919] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:21 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:22.269486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:22.270106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:22.272632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=8 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:22.277946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:22.278517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:22.279335 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:22.279889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:22.440866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:22.448835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d7558721-dfad-48ca-a940-c328836270fa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.183624 Jul 25 19:16:22.449591 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 446/920] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:22 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:23.470878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:23.471530 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:23.473590 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=10 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:23.478450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:23.478904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:23.479675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:23.480109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:23.615512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:23.623393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-02ca8986-94ab-436c-8c4f-3113e3dfcfcc tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.157856 Jul 25 19:16:23.623965 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 475/921] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:23 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:24.645507 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:24.646773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:24.653791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:24.654234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:24.655104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:24.655569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:24.819497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:24.829213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fdddf032-0635-4be9-9c41-1d6e198406ef tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.187367 Jul 25 19:16:24.839683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 447/922] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:24 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:24.978496 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-2faeda94-1acd-41ef-8a0c-5da028cfb5f6 req-60022c8b-26d4-4a97-90cb-7befcd3eb71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cda365-54af-4db5-857e-91948f2d7503", "name": "network-vif-plugged", "status": "completed", "tag": "52683359-7607-4c5f-8e77-291378a6ff24"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:24.989385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-2faeda94-1acd-41ef-8a0c-5da028cfb5f6 req-60022c8b-26d4-4a97-90cb-7befcd3eb71b service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:24.994559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-2faeda94-1acd-41ef-8a0c-5da028cfb5f6 req-60022c8b-26d4-4a97-90cb-7befcd3eb71b service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:25.002300 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-2faeda94-1acd-41ef-8a0c-5da028cfb5f6 req-60022c8b-26d4-4a97-90cb-7befcd3eb71b service nova] Creating event network-vif-plugged:52683359-7607-4c5f-8e77-291378a6ff24 for instance d8cda365-54af-4db5-857e-91948f2d7503 on hv-cinder-82002 Jul 25 19:16:25.007490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-2faeda94-1acd-41ef-8a0c-5da028cfb5f6 req-60022c8b-26d4-4a97-90cb-7befcd3eb71b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171099 Jul 25 19:16:25.008150 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 476/923] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:25.850945 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:25.851575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:25.858074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:25.858554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:25.859746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:25.860253 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:26.002782 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:26.010385 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e5e488bd-b1c3-4aa8-bdc2-7788033ebac6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1364 microversion: 2.1 time: 0.163328 Jul 25 19:16:26.010965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 448/924] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:25 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:27.033415 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:27.036424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:27.040499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:27.040939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:27.041718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:27.042139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:27.177132 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:27.185137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5b18b2d7-28c0-4aab-b6a8-2c587d7febb2 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1551 microversion: 2.1 time: 0.157575 Jul 25 19:16:27.185605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 477/925] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:27 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:27.206451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:27.206997 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:27.213816 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:27.214261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:27.215066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:27.215501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:27.306937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-259e81b2-053d-44f2-90cb-5b2b11728edb tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104763 Jul 25 19:16:27.307563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 449/926] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:16:27 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:16:28.355432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-67f54455-2dce-4dee-8691-7970127ecc41 req-f14351c7-e26b-476e-939f-07704de0456f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cda365-54af-4db5-857e-91948f2d7503", "tag": "52683359-7607-4c5f-8e77-291378a6ff24"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:28.366180 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-67f54455-2dce-4dee-8691-7970127ecc41 req-f14351c7-e26b-476e-939f-07704de0456f service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:28.370853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-67f54455-2dce-4dee-8691-7970127ecc41 req-f14351c7-e26b-476e-939f-07704de0456f service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:28.378809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-67f54455-2dce-4dee-8691-7970127ecc41 req-f14351c7-e26b-476e-939f-07704de0456f service nova] Creating event network-changed:52683359-7607-4c5f-8e77-291378a6ff24 for instance d8cda365-54af-4db5-857e-91948f2d7503 on hv-cinder-82002 Jul 25 19:16:28.384276 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-67f54455-2dce-4dee-8691-7970127ecc41 req-f14351c7-e26b-476e-939f-07704de0456f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032717 Jul 25 19:16:28.384867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 478/927] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:16:39.658110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:39.661361 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=62 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:39.663151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:39.663709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:39.669550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:39.669906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:39.670857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:39.671287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:39.694808 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lazy-loading 'flavor' on Instance uuid 08be3488-9017-42d8-99ed-63e8fe344653 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:16:40.058725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ee4fc5cf-56af-4ce4-8723-aad98478bbd9 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "POST /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653/action" status: 202 len: 0 microversion: 2.1 time: 0.401875 Jul 25 19:16:40.069230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:40.070154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:40.073581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=11 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:40.074267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 450/928] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:16:39 2022] POST /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:16:40.074719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:40.082209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:40.083440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:40.084292 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:40.084731 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:40.253206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:40.260946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c08b155d-72bd-4831-b919-9e371454c3ce tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.196681 Jul 25 19:16:40.261500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 479/929] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:40 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:41.284422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:41.285272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:41.292407 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:41.292849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:41.293617 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:41.294047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:41.443043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:41.450894 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4c2164d3-ac9e-49f9-af0f-d6d34f109ddf tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.171062 Jul 25 19:16:41.451565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 451/930] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:41 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:16:42.473751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:42.474472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:42.481829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:42.482278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:42.483086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:42.483593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:42.621967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:42.630199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-00c8e11e-2196-4417-a5c9-0bb8f28779d1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.160345 Jul 25 19:16:42.630810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 480/931] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:42 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:43.653553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:43.654169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:43.662081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:43.662637 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:43.663426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:43.664036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:43.803167 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:43.822151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c6a6f919-641a-4ec2-8e1b-ce1cdd072f9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.162158 Jul 25 19:16:43.822151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 452/932] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:43 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:44.843422 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:44.844338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:44.851041 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:44.851795 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:44.852281 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:44.852725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:45.018368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:45.026851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c8aa60eb-b5cb-4684-8cf4-c44d91f792b7 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.187880 Jul 25 19:16:45.027842 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 481/933] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:44 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:46.048894 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:46.049456 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:46.055882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:46.056335 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:46.057099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:46.057536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:46.199269 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:46.207984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d09395b9-49fb-4148-a509-d35ccbe9506d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.163441 Jul 25 19:16:46.208551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 453/934] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:46 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:47.230675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:47.231296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:47.238820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:47.239265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:47.240044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:47.240474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:47.394421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:47.402486 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4886cb92-6310-445f-8190-f8fbc37ed5c6 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.175811 Jul 25 19:16:47.403064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 482/935] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:47 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:48.425431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:48.425964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:48.432746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:48.433199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:48.433981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:48.434445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:48.573056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:48.580878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0ca140d8-aea6-4950-ab5d-0e1509afff8b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.159665 Jul 25 19:16:48.581446 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 454/936] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:48 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:49.602986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:49.603790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:49.610513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:49.610961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:49.611790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:49.612176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:49.753164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:49.761141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8166f9ec-9114-4e15-a26a-cf8bc8563a9d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.161877 Jul 25 19:16:49.761714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 483/937] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:49 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:50.785795 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:50.786358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:50.795104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:50.796284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:50.797341 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:50.797776 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:51.031136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:51.041456 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d437c67f-d323-4a19-95d1-386eb9357b55 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.259930 Jul 25 19:16:51.056327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 455/938] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:50 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:52.063404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:52.064117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:52.071309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:52.071813 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:52.072617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:52.073056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:52.227069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:52.235586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c6104cb3-2f82-441a-a93a-6c58d2dbba6c tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.176287 Jul 25 19:16:52.236340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 484/939] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:52 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:53.257567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:53.258171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:53.264886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:53.269783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:53.269783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:53.269783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:53.405169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:53.414141 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9c48c17b-9ae5-41a1-9f67-ab15c7e36721 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.160576 Jul 25 19:16:53.414641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 456/940] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:53 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:54.437248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:54.437859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:54.444334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:54.444719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:54.445495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:54.445936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:54.599373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:54.607380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-81c4ae28-ce0e-4660-a701-bba0f02c2463 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1507 microversion: 2.1 time: 0.174973 Jul 25 19:16:54.608490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 485/941] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:54 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:54.630829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:54.631406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:54.638259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:54.638765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:54.640320 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:54.640753 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:54.864816 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-32df1a00-431c-4a2e-9754-369a9fa7beb3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "POST /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653/action" status: 202 len: 0 microversion: 2.1 time: 0.237581 Jul 25 19:16:54.865451 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 457/942] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:16:54 2022] POST /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:16:54.874992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:54.875652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:54.882149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:54.882639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:54.883513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:54.883865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:55.026459 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:55.034154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7776532f-3e3a-4741-9768-604fc2546ed4 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1515 microversion: 2.1 time: 0.163880 Jul 25 19:16:55.034752 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 486/943] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:54 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:56.056181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:56.056778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:56.063814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:56.064268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:56.065033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:56.065474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:56.206388 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:56.214142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-509abedb-721d-4661-b989-9fa669bf82a3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1517 microversion: 2.1 time: 0.161833 Jul 25 19:16:56.214802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 458/944] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:56 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:56.887202 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-2d33c8fa-6b13-4a15-beab-77473dc56fa2 req-2866413e-89fc-419d-bbfb-e53d4812dbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "name": "network-vif-unplugged", "status": "completed", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:16:56.900998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-2d33c8fa-6b13-4a15-beab-77473dc56fa2 req-2866413e-89fc-419d-bbfb-e53d4812dbc8 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:56.901802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-2d33c8fa-6b13-4a15-beab-77473dc56fa2 req-2866413e-89fc-419d-bbfb-e53d4812dbc8 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:56.915071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.compute.server_external_events [req-2d33c8fa-6b13-4a15-beab-77473dc56fa2 req-2866413e-89fc-419d-bbfb-e53d4812dbc8 service nova] Unable to find a host for instance 08be3488-9017-42d8-99ed-63e8fe344653. Dropping event network-vif-unplugged {{(pid=125166) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 19:16:56.916083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-2d33c8fa-6b13-4a15-beab-77473dc56fa2 req-2866413e-89fc-419d-bbfb-e53d4812dbc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032665 Jul 25 19:16:56.916629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 487/945] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 19:16:57.238204 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:57.238821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:57.245616 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:57.246051 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:57.246846 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:57.247314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:57.392223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:57.400016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-28a78b57-213e-4377-8473-8788dd0c9ba3 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.165879 Jul 25 19:16:57.400588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 459/946] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:57 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:58.421996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:58.422630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:58.429380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:58.429840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:58.430649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:58.431092 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:58.569580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:58.577463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ec75dbe2-68cd-4a70-b067-a944f1a2081d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.160119 Jul 25 19:16:58.578050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 488/947] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:58 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:16:59.599933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:16:59.600538 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:16:59.607475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:59.608520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:59.609464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:16:59.609948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:16:59.755013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:16:59.767889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e586653a-1f90-48a2-8a6c-e2d4fade6873 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.171476 Jul 25 19:16:59.769915 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 460/948] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:16:59 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:00.794559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:00.795253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:00.803267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:00.803820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:00.804696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:00.805170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:00.952478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:00.959732 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dd88c323-031e-4664-b0e2-38ee23d096fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.169700 Jul 25 19:17:00.960511 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 489/949] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:00 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:01.982464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:01.986001 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:01.990301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:01.990788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:01.991590 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:01.992026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:02.138918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:02.147243 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-da8dfe34-e280-4763-8258-a847ebb087ff tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.168786 Jul 25 19:17:02.148063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 461/950] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:01 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:03.169229 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:03.169930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:03.177465 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:03.177912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:03.178787 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:03.179208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:03.314253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:03.321806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-edf1620d-e3a8-40bd-8b8a-2f2588843d07 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.156610 Jul 25 19:17:03.322395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 490/951] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:03 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:04.343332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:04.343943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:04.350449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:04.350891 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:04.351653 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:04.352079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:04.489567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:04.497854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a63abb74-3750-486f-8f15-1c37e27f80b1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.158687 Jul 25 19:17:04.499237 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 462/952] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:04 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:05.520402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:05.521310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:05.527737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:05.528180 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:05.528953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:05.529409 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:05.664819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:05.673170 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7e3e800c-ffd3-495f-a9cf-f843f8dd0b94 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.156710 Jul 25 19:17:05.673741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 491/953] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:05 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:06.695699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:06.696335 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:06.703293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:06.703740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:06.704512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:06.704975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:06.724146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:06.844760 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:06.852572 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-97ebe0e7-2f12-42fa-a7f5-ff26e4b200db tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.160715 Jul 25 19:17:06.853143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 463/954] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:06 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:07.876522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:07.877072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:07.883882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:07.884369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:07.885196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:07.885631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:08.038812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:08.047278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-19b6febe-7295-46e7-8f94-79d870b9988d tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.175317 Jul 25 19:17:08.047607 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 492/955] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:07 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:08.424183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:08.424605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:08.434100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:08.434100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:08.434100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:08.434100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:08.458383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-54d42801-476a-4b77-8d95-2521d7cac8c0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/ips" status: 200 len: 152 microversion: 2.20 time: 0.274221 Jul 25 19:17:08.458923 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 464/956] 10.222.0.17 () {60 vars in 1289 bytes} [Mon Jul 25 19:17:08 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/ips => generated 152 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:17:08.990020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-a9ced237-60fd-4114-904d-73cd6c630fc1 req-796dc8d1-9258-41e8-b0dc-4ec2f490592a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "name": "network-vif-plugged", "status": "completed", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:09.002293 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-a9ced237-60fd-4114-904d-73cd6c630fc1 req-796dc8d1-9258-41e8-b0dc-4ec2f490592a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:09.002877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-a9ced237-60fd-4114-904d-73cd6c630fc1 req-796dc8d1-9258-41e8-b0dc-4ec2f490592a service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:09.017784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-a9ced237-60fd-4114-904d-73cd6c630fc1 req-796dc8d1-9258-41e8-b0dc-4ec2f490592a service nova] Creating event network-vif-plugged:917d51f6-d780-4f2f-b965-f032f1e24916 for instance 08be3488-9017-42d8-99ed-63e8fe344653 on hv-cinder-82002 Jul 25 19:17:09.023121 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-a9ced237-60fd-4114-904d-73cd6c630fc1 req-796dc8d1-9258-41e8-b0dc-4ec2f490592a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036834 Jul 25 19:17:09.023905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 493/957] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:17:09.069378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:09.070085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:09.078377 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:09.078896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:09.079816 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:09.080250 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:09.248539 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:09.248539 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-490cdc8d-f939-4907-80b5-d9fdcfc2de62 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.182460 Jul 25 19:17:09.248539 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 465/958] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:09 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:10.271116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:10.271819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:10.274207 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=31 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:10.279879 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:10.280403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:10.281396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:10.281836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:10.423237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:10.431831 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3a561223-8973-4950-83f3-6b71c76dd9fd tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.165120 Jul 25 19:17:10.432444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 494/959] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:10 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:11.453081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:11.453844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:11.456085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=35 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:11.460905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:11.461350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:11.462117 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:11.462573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:11.606853 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:11.615694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-801e6436-a8c6-4ba0-9949-6fc746ab8a6b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1573 microversion: 2.1 time: 0.166768 Jul 25 19:17:11.616286 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 466/960] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:11 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:11.882619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:11.883145 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:11.890295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:11.893943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:11.893943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:11.893943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:11.918564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lazy-loading 'flavor' on Instance uuid 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:17:12.035963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:12.359459 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-193a0717-d217-44af-9cf0-c71d483698ea tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/action" status: 202 len: 0 microversion: 2.20 time: 0.480772 Jul 25 19:17:12.360053 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 495/961] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Jul 25 19:17:11 2022] POST /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:17:12.368652 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:12.369528 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:12.376470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:12.376886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:12.377651 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:12.378135 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:12.513133 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:12.522439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:12.523953 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:12.525119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0217d1a9-3470-4d04-af1f-255bb184c4b7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.160483 Jul 25 19:17:12.525681 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 467/962] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:12 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:12.637781 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:12.639069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:12.645886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:12.646350 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:12.647144 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:12.647577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:12.786258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:12.793964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7c4b98ad-8403-4652-9f33-37de55bf1429 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1560 microversion: 2.1 time: 0.160515 Jul 25 19:17:12.794765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 496/963] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:17:12 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:17:13.550043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:13.550670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:13.557117 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:13.557564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:13.558343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:13.558776 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:13.693524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:13.701400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:13.702999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:13.704222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4140694b-ec3d-4cdd-aa51-3fcb52449514 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.158151 Jul 25 19:17:13.704699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 468/964] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:13 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:14.726991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:14.727639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:14.734498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:14.734948 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:14.735724 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:14.736168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:14.872318 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:14.880440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:14.881948 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:14.883149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d9ef9d67-9924-4835-a163-db135f2ca947 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.160335 Jul 25 19:17:14.883702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 497/965] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:14 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:15.907643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:15.908266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:15.915082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:15.919219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:15.919219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:15.919219 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:16.052773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:16.061228 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:16.063065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:16.064265 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-45eb54ad-1714-4fae-a8c1-3afb206591ad tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.161327 Jul 25 19:17:16.064830 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 469/966] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:15 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:17.090209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:17.090865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:17.097688 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:17.098140 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:17.098984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:17.099416 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:17.239538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:17.248606 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:17.250341 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:17.251525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0d896b8f-ad50-441e-b404-255a70874875 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.165352 Jul 25 19:17:17.252088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 498/967] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:17 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:18.275416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:18.276017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:18.283551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:18.283996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:18.284768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:18.285203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:18.425837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:18.434317 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:18.436208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:18.437367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3a06695f-65ae-41ce-9445-472ce8b3a1c5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.165902 Jul 25 19:17:18.437921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 470/968] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:18 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:19.461882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:19.462523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:19.470146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:19.475166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:19.475166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:19.475166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:19.620782 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:19.629605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:19.631162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:19.632332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-11403c6b-9436-4523-adf1-4d1ac4d833ae tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.174511 Jul 25 19:17:19.632895 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 499/969] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:19 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:20.656955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:20.657561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:20.664304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:20.664741 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:20.665623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:20.666050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:20.799930 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:20.808814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:20.811071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:20.812247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-55afd2b8-8885-4197-bc03-a95031adc65e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.159802 Jul 25 19:17:20.812804 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 471/970] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:20 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:21.835995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:21.836705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:21.843217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:21.843661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:21.844427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:21.844857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:21.987367 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:21.995995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:21.997515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:21.999334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6b0a1018-d436-4044-9925-75f730475e42 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.167321 Jul 25 19:17:22.000101 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 500/971] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:21 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:23.022844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:23.023448 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:23.031032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:23.031474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:23.032248 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:23.032687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:23.169800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:23.178013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:23.179535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:23.180678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e03d20fa-5976-4fc8-822c-8ef889e425eb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.161725 Jul 25 19:17:23.181261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 472/972] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:23 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:24.205108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:24.205721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:24.211981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:24.212427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:24.213197 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:24.213635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:24.348029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:24.356144 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:24.358456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:24.359623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3ab25555-42e9-4331-a094-bee932cfe908 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.158795 Jul 25 19:17:24.360189 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 501/973] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:24 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:25.383259 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:25.383850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:25.390432 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:25.390930 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:25.391697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:25.392131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:25.526099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:25.535376 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:25.536843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:25.537990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6fe9e7f5-c7a4-4cd6-a3fe-2f15fc4e4831 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.158642 Jul 25 19:17:25.538585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 473/974] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:25 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:26.561180 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:26.561883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:26.569224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:26.569677 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:26.570475 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:26.570917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:26.724396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:26.732483 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:26.733996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:26.735248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d2e13638-2685-4d21-bdc8-035465d45f76 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.178145 Jul 25 19:17:26.735992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 502/975] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:26 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:27.759216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:27.759870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:27.766967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:27.767403 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:27.768169 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:27.768593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:27.905503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:27.913797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:27.915405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:27.916560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-09704dd6-1b5d-4d87-b5a5-7cca1b13a73e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.161548 Jul 25 19:17:27.917238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 474/976] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:27 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:28.940539 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:28.941314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:28.948159 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:28.948605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:28.949375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:28.949805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:29.083724 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:29.092080 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:29.093639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:29.094852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bf529fc9-2c10-41b4-a0d8-81b3ca8c8301 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.158330 Jul 25 19:17:29.095412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 503/977] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:28 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:17:30.119475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:30.120133 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:30.127720 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:30.128156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:30.128917 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:30.129364 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:30.266017 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:30.274082 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:30.279275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:30.279275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-03b9c872-17ed-4398-926b-8f88e48ad166 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.161550 Jul 25 19:17:30.279275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 475/978] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:30 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:31.303652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:31.307771 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:31.311679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:31.312118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:31.312932 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:31.314204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:31.460746 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:31.469661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:31.471288 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:31.472474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-96f4104c-b798-418b-bc49-d284fa628cf5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.172960 Jul 25 19:17:31.473032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 504/979] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:31 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:32.503819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:32.504440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:32.510792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:32.511237 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:32.511999 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:32.512424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:32.647465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:32.656000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:32.657554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:32.658754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5bcc01ad-05df-4501-949c-055e7b0fd317 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.159122 Jul 25 19:17:32.659314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 476/980] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:32 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:33.184573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-bc45a61c-6376-45a2-bd03-6ab0295ac74b req-6775368e-27ea-4eb3-af7b-f41904aae5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "name": "network-vif-plugged", "status": "completed", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:33.194799 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-bc45a61c-6376-45a2-bd03-6ab0295ac74b req-6775368e-27ea-4eb3-af7b-f41904aae5fb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:33.195243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-bc45a61c-6376-45a2-bd03-6ab0295ac74b req-6775368e-27ea-4eb3-af7b-f41904aae5fb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:33.206255 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-bc45a61c-6376-45a2-bd03-6ab0295ac74b req-6775368e-27ea-4eb3-af7b-f41904aae5fb service nova] Creating event network-vif-plugged:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:17:33.211320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-bc45a61c-6376-45a2-bd03-6ab0295ac74b req-6775368e-27ea-4eb3-af7b-f41904aae5fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 Jul 25 19:17:33.211920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 505/981] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:17:33.683360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:33.683974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:33.693886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:33.694473 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:33.695269 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:33.695733 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:33.835261 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:33.843967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:33.845563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:33.846780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-96ab770a-6d7d-48c8-8427-e18bfa0ebf8b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.167418 Jul 25 19:17:33.847339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 477/982] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:33 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:34.870648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:34.871402 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:34.877649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:34.878088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:34.878898 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:34.879334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:35.015361 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:35.023635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:35.025146 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:35.026312 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-523ae941-e9f3-4880-a6da-d9eebfd6a063 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.160886 Jul 25 19:17:35.026886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 506/983] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:34 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:36.050849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:36.051452 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:36.058009 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:36.058497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:36.059265 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:36.059867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:36.189967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:36.197917 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:36.199443 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:36.200832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9aa0a63b-4f77-4b88-9a12-2f7c17737604 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.153672 Jul 25 19:17:36.201556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 478/984] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:36 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:37.225410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:37.225999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:37.233193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:37.233632 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:37.234454 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:37.234884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:37.369910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:37.378501 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:37.380011 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:37.381216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-88e0e2df-d125-467e-bd6d-d88cd670f3a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1746 microversion: 2.20 time: 0.159790 Jul 25 19:17:37.381775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 507/985] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:37 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:38.405392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:38.406024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:38.412615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:38.413170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:38.413932 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:38.414396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:38.418417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=91 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:38.570050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:38.579821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:38.581370 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:38.582778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e13d4d06-96d3-4fdc-815e-edd9da387e64 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.181637 Jul 25 19:17:38.583354 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 479/986] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:38 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:39.609395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:39.609999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:39.620510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:39.620994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:39.621861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:39.622365 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:39.822690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:39.832673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:39.834175 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:39.835371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-86f20594-0f2a-4d09-9ec8-6b5ad0e2a759 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.231181 Jul 25 19:17:39.837985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 508/987] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:39 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:40.873502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:40.874630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:40.886203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:40.887464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:40.889765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:40.890488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:41.048942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:41.059654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:41.063458 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:41.063458 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f71a2916-5155-48e7-a425-641585607c62 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.198011 Jul 25 19:17:41.064619 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 480/988] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:40 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:42.088861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:42.089506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:42.092536 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=30 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:42.097581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:42.098115 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:42.098882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:42.099330 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:42.246863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:42.256719 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:42.274462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:42.293346 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:42.293346 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7f7e6142-e25e-4de0-aa93-1d0205aa05b0 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.193113 Jul 25 19:17:42.293346 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 509/989] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:42 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:43.307623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:43.308346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:43.311150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=30 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:43.316408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:43.316899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:43.317671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:43.318102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:43.476577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:43.485661 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:43.487352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:43.488606 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ed065945-5eb0-4f7f-8e5e-b19b46da2d3b tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.184843 Jul 25 19:17:43.489377 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 481/990] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:43 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:44.514953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:44.515852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:44.524471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:44.524976 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:44.525785 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:44.526761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:44.690086 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:44.699018 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:44.701424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:44.703829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1cfe81fc-ebe6-48d3-9e06-079a38a826d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.193182 Jul 25 19:17:44.704641 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 510/991] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:44 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:45.730881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:45.732152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:45.739543 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:45.739864 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:45.740727 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:45.741242 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:45.885856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:45.895047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:45.896573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:45.897716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a3474b11-5476-437c-a7a9-f24ecd11ebde tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.171194 Jul 25 19:17:45.898276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 482/992] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:45 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:46.922102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:46.922694 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:46.929001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:46.929443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:46.930210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:46.930671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:47.108543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:47.117199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:47.119217 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:47.120396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8735a0dd-f153-4999-a96f-9df43dd35fdc tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.203194 Jul 25 19:17:47.128877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 511/993] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:46 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:48.144608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:48.145273 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:48.152280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:48.152722 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:48.154152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:48.154983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:48.298996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:48.308314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:48.309937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:48.311134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3da7a311-df61-4887-aa08-30e8cbc4e93d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.170702 Jul 25 19:17:48.311730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 483/994] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:48 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:49.334709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:49.335436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:49.345765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:49.346216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:49.347087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:49.347528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:49.514247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:49.525254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:49.536109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:49.537243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-81ae4070-7c93-477c-be4a-dcd43bebe0d5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.205661 Jul 25 19:17:49.541919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 512/995] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:49 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:50.563600 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:50.564218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:50.571499 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:50.571972 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:50.573290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:50.573490 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:50.737005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:50.748783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:50.750657 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:50.753517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-81bc26ee-3b3e-4cd4-8542-9ebaf551b66a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.194309 Jul 25 19:17:50.766354 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 484/996] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:50 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:51.783165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:51.783786 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:51.790507 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:51.801737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:51.801737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:51.801737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:51.935486 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:51.943738 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:51.945254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:51.953802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-37f8b611-d489-49fd-bfc7-45edbf82bbd9 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1741 microversion: 2.20 time: 0.167465 Jul 25 19:17:51.953802 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 513/997] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:51 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:52.970168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:52.970873 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:52.977523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:52.977967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:52.978909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:52.979202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:53.193338 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:53.202132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:53.203651 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:53.204805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a9b9a80c-f7ae-41d3-910a-991a4c460001 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1723 microversion: 2.20 time: 0.239544 Jul 25 19:17:53.205361 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 485/998] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:52 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:54.228760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:54.229370 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:54.236267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:54.236805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:54.237597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:54.238037 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:54.386277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:54.394886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:54.396397 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:54.397562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a054b63d-7c65-4de5-9df3-8445cb868419 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1723 microversion: 2.20 time: 0.172984 Jul 25 19:17:54.398118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 514/999] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:54 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:55.181968 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-49a67aeb-92e5-4fb1-82f3-cdbba5413a0e req-a6147682-676d-4bbc-9c84-3c8871362bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "name": "network-vif-unplugged", "status": "completed", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:55.193294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-49a67aeb-92e5-4fb1-82f3-cdbba5413a0e req-a6147682-676d-4bbc-9c84-3c8871362bc5 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:55.193850 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-49a67aeb-92e5-4fb1-82f3-cdbba5413a0e req-a6147682-676d-4bbc-9c84-3c8871362bc5 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:55.204941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-49a67aeb-92e5-4fb1-82f3-cdbba5413a0e req-a6147682-676d-4bbc-9c84-3c8871362bc5 service nova] Creating event network-vif-unplugged:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:17:55.210045 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-49a67aeb-92e5-4fb1-82f3-cdbba5413a0e req-a6147682-676d-4bbc-9c84-3c8871362bc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031770 Jul 25 19:17:55.211004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 486/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:17:55.421534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:55.422125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:55.428859 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:55.429300 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:55.430073 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:55.430531 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:55.576842 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:55.586541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:55.587955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:55.589115 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-140d55f1-899d-41ab-9968-1efd2b2e7398 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1723 microversion: 2.20 time: 0.172338 Jul 25 19:17:55.589737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 515/1001] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:55 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:56.614481 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:56.615182 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:56.621912 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:56.622585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:56.623373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:56.623807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:56.760289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:56.768959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:56.770475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:56.771609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e7bff659-6e96-48e3-ac5e-5de86addf4be tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1666 microversion: 2.20 time: 0.162113 Jul 25 19:17:56.772170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 487/1002] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:56 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:17:56.794534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a89e4e6-cbf9-41a9-89aa-fb72c9b928b5"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:56.796969 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:56.803506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:56.803939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:56.804707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:56.805137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:57.876042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a0d2473a-7a8f-4f49-8972-0d36b61f2a74 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.085524 Jul 25 19:17:57.876709 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 516/1003] 10.222.0.17 () {62 vars in 1364 bytes} [Mon Jul 25 19:17:56 2022] POST /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-volume_attachments => generated 188 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:17:58.010313 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:58.010897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:58.018378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:58.018832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:58.019588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:58.020014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:58.705072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-038e5c2e-ea3b-4a39-8586-677a4edb9b05 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-volume_attachments/0a89e4e6-cbf9-41a9-89aa-fb72c9b928b5" status: 202 len: 0 microversion: 2.20 time: 0.698980 Jul 25 19:17:58.705641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 488/1004] 10.222.0.17 () {60 vars in 1457 bytes} [Mon Jul 25 19:17:58 2022] DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-volume_attachments/0a89e4e6-cbf9-41a9-89aa-fb72c9b928b5 => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:17:58.766611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:17:58.774102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:58.774102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:58.774102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:58.774509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:58.774942 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:59.032962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-38dc4ff2-6139-4174-88b3-2999637d482d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "POST /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/action" status: 202 len: 0 microversion: 2.20 time: 0.269912 Jul 25 19:17:59.036887 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 517/1005] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Jul 25 19:17:58 2022] POST /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:17:59.042129 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:17:59.042837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:17:59.050671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:59.051148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:59.052044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:17:59.052532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:17:59.191153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:59.199689 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:59.201331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:17:59.202535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-eaae939c-3627-4a7b-85f3-59269dc08bfe tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1674 microversion: 2.20 time: 0.164323 Jul 25 19:17:59.203099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 489/1006] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:17:59 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:00.229764 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:00.230381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:00.237291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:00.237732 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:00.238529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:00.238961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:00.380119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:00.394487 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:00.396009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:00.397156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9c788c6c-62a0-4741-8016-80403b6d86a6 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1674 microversion: 2.20 time: 0.172092 Jul 25 19:18:00.397725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 518/1007] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:00 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:01.422532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:01.423920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:01.431483 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:01.431958 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:01.433296 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:01.433772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:01.650282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:01.659444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:01.660950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:01.662128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2a660d1a-5b2f-407d-ba15-c1de85eac107 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.243876 Jul 25 19:18:01.662719 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 490/1008] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:01 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:02.691615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:02.693241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:02.700642 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:02.701195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:02.702060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:02.702948 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:02.933042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:02.946658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:02.951715 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:02.953696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1d6457cf-42f3-4f38-bd28-8fbaac5dd133 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.270995 Jul 25 19:18:02.959556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 519/1009] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:02 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:03.979015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:03.979719 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:03.987373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:03.987814 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:03.988620 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:03.989378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:04.159299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:04.168924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:04.170522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:04.171780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-68fa7f2b-11c3-4619-ac96-d2032cb5d5fb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.197133 Jul 25 19:18:04.173315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 491/1010] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:03 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:05.196259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:05.198528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:05.204580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:05.205127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:05.205995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:05.206558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:05.368961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:05.382284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:05.384494 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:05.385127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-06eb6386-c770-44e6-bea9-f24a1c5b440e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.193282 Jul 25 19:18:05.385904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 520/1011] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:05 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:06.415114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:06.415835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:06.422888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:06.423432 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:06.424484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:06.425013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:06.566960 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:06.575332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:06.576853 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:06.578021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-96cb5c11-be54-4205-bc4a-026a77305db3 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.166912 Jul 25 19:18:06.578626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 492/1012] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:06 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:07.602732 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:07.603351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:07.610887 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:07.611344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:07.612133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:07.612566 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:07.772091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:07.784975 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:07.786827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:07.788406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d94639e6-5de4-4ca8-b258-8c0cff3f3eaa tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.189727 Jul 25 19:18:07.800468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 521/1013] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:07 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:08.814834 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:08.815553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:08.821995 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:08.822594 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:08.823431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:08.823943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:08.827665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:08.985394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:08.994144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:08.995675 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:08.997528 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-cc994b2f-da29-4640-a90b-dc69796e0fbb tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.187807 Jul 25 19:18:08.998276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 493/1014] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:08 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:10.021570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:10.022219 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:10.031600 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:10.032395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:10.033450 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:10.034038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:10.187294 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:10.189436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:10.196495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:10.206453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:10.206453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5b1ca3cf-0fb0-482d-af14-52d0ece4ae9e tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.181702 Jul 25 19:18:10.206453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 522/1015] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:10 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:10.538725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:10.539479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:10.547265 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:10.547835 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:10.548673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:10.549317 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:10.584277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7e06ffe3-2258-4692-9015-94a1002dda5d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/ips" status: 200 len: 147 microversion: 2.1 time: 0.049680 Jul 25 19:18:10.584943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 494/1016] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:18:10 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:18:11.226790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:11.227571 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:11.236481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:11.237218 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:11.238283 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:11.238928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:11.435425 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:11.447726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:11.460875 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:11.462726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-14774419-bef0-42ec-9eb0-03224d25227c tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.240780 Jul 25 19:18:11.463720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 523/1017] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:11 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:12.491481 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:12.492129 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:12.500019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:12.500467 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:12.501620 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:12.501745 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:12.643439 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:12.651787 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:12.654050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:12.655282 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dc2afd20-3eec-4862-82b5-0696809aa33a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.167717 Jul 25 19:18:12.655847 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 495/1018] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:12 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:13.581506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b639352-18f1-4ca3-98c3-ab4fee9a815e"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:18:13.584069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:13.586738 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=32 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:13.592774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:13.593221 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:13.594001 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:13.594475 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:13.680882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:13.681577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:13.683823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=30 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:13.688655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:13.689101 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:13.689867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:13.690402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:13.978157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:13.989375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:13.990980 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:13.992151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-601f8e65-b5a1-4d1f-aa03-81bac16b8535 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.315632 Jul 25 19:18:13.992942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 496/1019] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:13 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:15.016728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:15.017390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:15.024489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:15.024928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:15.025703 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:15.026142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:15.168595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:15.177059 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:15.178660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:15.179815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-87b2307a-aa25-41de-9426-a9021a285d3a tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.167695 Jul 25 19:18:15.180363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 497/1020] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:15 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:16.204770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:16.205453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:16.212183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:16.212635 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:16.213403 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:16.213865 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:16.363240 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:16.372840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:16.375004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:16.376175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dd2d7a6e-b593-4aa0-98cd-179deb042619 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.176888 Jul 25 19:18:16.376723 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 498/1021] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:16 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:17.399164 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:17.399849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:17.407869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:17.408316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:17.409103 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:17.409542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:17.552916 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:17.561829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:17.563346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:17.564551 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6c58089d-552a-4258-bab2-5fc478fe6eb7 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.169351 Jul 25 19:18:17.565105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 499/1022] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:17 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:18.588149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:18.588824 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:18.595207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:18.595647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:18.596393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:18.596819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:18.980318 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:18.989673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:18.991191 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:18.992362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c786372e-1dab-4539-9be8-0a9ddd58c6cf tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.408210 Jul 25 19:18:18.993158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 500/1023] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:18 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:18:20.017253 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:20.017945 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:20.024542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:20.024983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:20.025752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:20.026185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:20.177435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:20.187009 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:20.188640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:20.190013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6f76f040-c6a6-4006-b08a-7c1f8d63a27f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.177480 Jul 25 19:18:20.190622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 501/1024] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:20 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:20.846922 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bb615885-2958-491b-9a39-af6bfd054273 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.269169 Jul 25 19:18:20.847611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 524/1025] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:18:13 2022] POST /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments => generated 194 bytes in 7271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:21.215421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:21.217107 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:21.224250 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:21.224747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:21.225521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:21.225951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:21.332417 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-5f724ab8-e212-4fea-bb9f-234fa02f66c8 req-8d064ac5-bd05-43ab-8517-e7ceec173467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "name": "network-vif-plugged", "status": "completed", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:18:21.343264 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-5f724ab8-e212-4fea-bb9f-234fa02f66c8 req-8d064ac5-bd05-43ab-8517-e7ceec173467 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:21.343707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-5f724ab8-e212-4fea-bb9f-234fa02f66c8 req-8d064ac5-bd05-43ab-8517-e7ceec173467 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:21.357938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-5f724ab8-e212-4fea-bb9f-234fa02f66c8 req-8d064ac5-bd05-43ab-8517-e7ceec173467 service nova] Creating event network-vif-plugged:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:18:21.362991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-5f724ab8-e212-4fea-bb9f-234fa02f66c8 req-8d064ac5-bd05-43ab-8517-e7ceec173467 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035682 Jul 25 19:18:21.364881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 525/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:18:21.375450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:21.383831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:21.385332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:21.386590 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6c74b070-6147-467c-88a6-72297f50d0ac tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.175900 Jul 25 19:18:21.387158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 502/1027] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:21 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:22.411564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:22.412155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:22.419155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:22.419706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:22.420482 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:22.420917 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:22.553411 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:22.561470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:22.563009 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:22.564181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fb1731f8-524e-4178-9edf-873535816194 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.157646 Jul 25 19:18:22.564728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 526/1028] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:22 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:23.587729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:23.588328 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:23.594790 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:23.597565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:23.597565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:23.597565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:23.735821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:23.744080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:23.745567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:23.747289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d28d974f-e7d9-4993-8399-18e981ac45f1 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1732 microversion: 2.20 time: 0.162991 Jul 25 19:18:23.748108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 503/1029] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:23 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:24.771230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:24.771825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:24.779039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:24.779492 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:24.780272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:24.780707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:24.913851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:24.922427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:24.923919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:24.925102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d67e8d6d-a26f-43cc-a092-6804370f2437 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1719 microversion: 2.20 time: 0.157823 Jul 25 19:18:24.925649 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 527/1030] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:18:24 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:18:29.454010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:29.457037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:29.464023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:29.468832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:29.468832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:29.468832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:29.496358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-cf488585-dda5-4fdd-bd84-38cd1130edb4 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Jul 25 19:18:29.497455 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 504/1031] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:18:29 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:29.508823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:29.509366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:29.516004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:29.516447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:29.517205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:29.517633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:29.547249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-eb199fac-e722-4588-80b7-085e87ac0abd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/1b639352-18f1-4ca3-98c3-ab4fee9a815e" status: 200 len: 194 microversion: 2.1 time: 0.042340 Jul 25 19:18:29.547843 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 528/1032] 10.222.0.17 () {58 vars in 1413 bytes} [Mon Jul 25 19:18:29 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/1b639352-18f1-4ca3-98c3-ab4fee9a815e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:32.195573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b56d86-3a44-4c1a-9c5d-60871a12273e"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:18:32.197920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:32.204806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:32.205260 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:32.206101 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:32.206559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:32.971225 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9c05c13c-6805-4df1-8178-5b4b5af0ecdd tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "POST /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779537 Jul 25 19:18:32.971857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 505/1033] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:18:32 2022] POST /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:41.461378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:18:41.462028 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:18:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:18:41.563028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:41.565422 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:41.568051 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=9 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:41.568710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:41.573434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:41.573885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:41.574685 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:41.575119 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:41.605625 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e238cc61-b6c1-4a5b-8dac-f1afffd499db tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047043 Jul 25 19:18:41.606174 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 529/1034] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:18:41 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:41.748715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:41.749344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:41.756964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:41.757401 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:41.758160 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:41.758613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:41.761023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:41.788419 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5d528ff8-0aa0-4d9c-952c-c715dc27cdfa tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/1b639352-18f1-4ca3-98c3-ab4fee9a815e" status: 200 len: 194 microversion: 2.1 time: 0.044700 Jul 25 19:18:41.788990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 506/1035] 10.222.0.17 () {58 vars in 1413 bytes} [Mon Jul 25 19:18:41 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/1b639352-18f1-4ca3-98c3-ab4fee9a815e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:41.800040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:41.800568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:41.807110 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:41.807562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:41.808340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:41.808805 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:41.894975 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lazy-loading 'services' on Instance uuid d8cda365-54af-4db5-857e-91948f2d7503 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:18:42.258690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fd5be412-6b0b-44b4-9712-7e6ed8e063ac tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/1b639352-18f1-4ca3-98c3-ab4fee9a815e" status: 202 len: 0 microversion: 2.1 time: 0.463085 Jul 25 19:18:42.259527 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 530/1036] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:18:41 2022] DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/1b639352-18f1-4ca3-98c3-ab4fee9a815e => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:18:44.437534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:44.438213 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:44.441341 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=22 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:44.446488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:44.446946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:44.447697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:44.448124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:44.480057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c441686c-6d74-4457-98bd-a131cbb91002 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/27b56d86-3a44-4c1a-9c5d-60871a12273e" status: 200 len: 194 microversion: 2.1 time: 0.047325 Jul 25 19:18:44.480661 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 507/1037] 10.222.0.17 () {58 vars in 1413 bytes} [Mon Jul 25 19:18:44 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/27b56d86-3a44-4c1a-9c5d-60871a12273e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:44.493951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:44.494590 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:44.500977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:44.501984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:44.502814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:44.503249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:44.588296 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lazy-loading 'services' on Instance uuid d8cda365-54af-4db5-857e-91948f2d7503 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:18:44.789602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f31ad1a7-58aa-4e87-95da-e78db601be8c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/27b56d86-3a44-4c1a-9c5d-60871a12273e" status: 202 len: 0 microversion: 2.1 time: 0.300988 Jul 25 19:18:44.790195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 531/1038] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:18:44 2022] DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments/27b56d86-3a44-4c1a-9c5d-60871a12273e => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:18:45.962071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:45.964362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:45.972394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:45.972841 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:45.973626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:45.974056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.003944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1d058528-ae1e-4435-89ce-b37b9be2ff5c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046347 Jul 25 19:18:46.004494 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 508/1039] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:18:45 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:18:46.119704 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:46.121982 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:46.129495 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:46.129942 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.130748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:46.131187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.163353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e3ca07ec-a919-43dc-9a94-d21b8a56a198 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048181 Jul 25 19:18:46.163919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 532/1040] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:18:46 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:18:46.227321 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:46.227941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:46.234159 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:46.234711 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.235586 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:46.236274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.263421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:18:46.663900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3b955a06-9c79-42fc-a01b-1cc48ff4cb67 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 204 len: 0 microversion: 2.1 time: 0.440577 Jul 25 19:18:46.664499 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 509/1041] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:18:46 2022] DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:18:46.672878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:46.674104 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:46.679548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:46.679995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.680760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:46.681196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:46.812881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:46.821209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c0164887-e0c4-4dff-8bbe-fcddeda0be2e tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1676 microversion: 2.1 time: 0.152217 Jul 25 19:18:46.821783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 533/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:46 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:18:47.844518 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:47.845866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:47.852018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:47.852472 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:47.853296 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:47.853706 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:47.988702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:47.996556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2d57c622-15ac-4d03-82ca-91c7ccab865b tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1676 microversion: 2.1 time: 0.156878 Jul 25 19:18:47.997124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 510/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:47 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:18:49.018567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:49.019172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:49.025648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:49.026091 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:49.026884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:49.027313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:49.162622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:49.170134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-16e002b9-5088-4018-abbe-d02ca87c530c tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1676 microversion: 2.1 time: 0.155672 Jul 25 19:18:49.170729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 534/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:49 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:18:49.787789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-bdcd0df2-9607-46db-b8a8-e1fb38752634 req-f492f4df-bc50-4e99-89a2-de4ba44d3f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cda365-54af-4db5-857e-91948f2d7503", "name": "network-vif-deleted", "tag": "52683359-7607-4c5f-8e77-291378a6ff24"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:18:49.800632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-bdcd0df2-9607-46db-b8a8-e1fb38752634 req-f492f4df-bc50-4e99-89a2-de4ba44d3f57 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:49.801080 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-bdcd0df2-9607-46db-b8a8-e1fb38752634 req-f492f4df-bc50-4e99-89a2-de4ba44d3f57 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:49.817280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-bdcd0df2-9607-46db-b8a8-e1fb38752634 req-f492f4df-bc50-4e99-89a2-de4ba44d3f57 service nova] Creating event network-vif-deleted:52683359-7607-4c5f-8e77-291378a6ff24 for instance d8cda365-54af-4db5-857e-91948f2d7503 on hv-cinder-82002 Jul 25 19:18:49.823585 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-bdcd0df2-9607-46db-b8a8-e1fb38752634 req-f492f4df-bc50-4e99-89a2-de4ba44d3f57 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115952 Jul 25 19:18:49.824823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 511/1045] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:18:50.194803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:50.195660 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:50.204267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:50.204727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:50.205861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:50.206385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:50.248133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:50.248585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:50.249040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lazy-loading 'fault' on Instance uuid d8cda365-54af-4db5-857e-91948f2d7503 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:18:50.296400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592de777b94148b791e18bf898386f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e929654eb2b4c1ca969174e94aa8de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:18:50.306508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1b301a7f-e58c-47d7-be93-ae49b5c57e2d tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 200 len: 1328 microversion: 2.1 time: 0.118107 Jul 25 19:18:50.307099 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 535/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:50 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:18:51.330583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:51.331277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:51.338408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:51.338854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:51.339618 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:51.340049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:51.354256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] HTTP exception thrown: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Request method failure captured: Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 HTTP/1.1 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk4AbZuX7Q1zjRdT0jZiyndCKO5951qSJAXUv82_F9DfMsAC-gxhMzkz-RmvSMPJi_qaBXH7Pz2USW6piei_KvrTtr8vrDR5-YXHgQ-1vZLuIwJCb0ZRGR-jpZ4xanAkONNjGXqzGmhnk9Ea5cTV1J9nURP6puZM5gtSauVtjzLoZ8 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:18:51.355956 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e929654eb2b4c1ca969174e94aa8de2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 592de777b94148b791e18bf898386f34 Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:51.359046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'd8cda365-54af-4db5-857e-91948f2d7503'} Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:18:51.360788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:51.364709 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:51.367587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Returning 404 to user: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:18:51.367587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5d6adfc0-b983-44c7-a8cb-65ebd4be7608 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 404 len: 111 microversion: 2.1 time: 0.031096 Jul 25 19:18:51.367587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 512/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:51 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:18:51.368079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-af3ae96b-8623-4965-914b-ce2189152e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '.version_select at 0x7fd8e5ceb8b0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:51.464975 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-af3ae96b-8623-4965-914b-ce2189152e60 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242645006" status: 202 len: 0 microversion: 2.1 time: 0.101662 Jul 25 19:18:51.465579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 536/1048] 10.222.0.17 () {58 vars in 1221 bytes} [Mon Jul 25 19:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242645006 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:18:55.143933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:55.144429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:55.150671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:55.151113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:55.151870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:55.152306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:55.166453 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] HTTP exception thrown: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Request method failure captured: Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 HTTP/1.1 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk4AbZuX7Q1zjRdT0jZiyndCKO5951qSJAXUv82_F9DfMsAC-gxhMzkz-RmvSMPJi_qaBXH7Pz2USW6piei_KvrTtr8vrDR5-YXHgQ-1vZLuIwJCb0ZRGR-jpZ4xanAkONNjGXqzGmhnk9Ea5cTV1J9nURP6puZM5gtSauVtjzLoZ8 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:18:55.168007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e929654eb2b4c1ca969174e94aa8de2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 592de777b94148b791e18bf898386f34 Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.169563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'd8cda365-54af-4db5-857e-91948f2d7503'} Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:18:55.173457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.175647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.177069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Returning 404 to user: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:18:55.177069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2508db00-1bf1-4c12-a80e-0bf310e0cc52 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 404 len: 111 microversion: 2.1 time: 0.029516 Jul 25 19:18:55.177069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 513/1049] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:18:55 2022] DELETE /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:18:55.178991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:55.179643 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: d8cda365-54af-4db5-857e-91948f2d7503] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:55.187223 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:55.187675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:55.188447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:55.188943 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:55.202620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] HTTP exception thrown: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Request method failure captured: Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 HTTP/1.1 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk4AbZuX7Q1zjRdT0jZiyndCKO5951qSJAXUv82_F9DfMsAC-gxhMzkz-RmvSMPJi_qaBXH7Pz2USW6piei_KvrTtr8vrDR5-YXHgQ-1vZLuIwJCb0ZRGR-jpZ4xanAkONNjGXqzGmhnk9Ea5cTV1J9nURP6puZM5gtSauVtjzLoZ8 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:18:55.207949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e929654eb2b4c1ca969174e94aa8de2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 592de777b94148b791e18bf898386f34 Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.209620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'd8cda365-54af-4db5-857e-91948f2d7503'} Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:18:55.210644 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. Jul 25 19:18:55.212152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:55.213872 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Returning 404 to user: Instance d8cda365-54af-4db5-857e-91948f2d7503 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:18:55.213872 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c9abc5a2-c991-44b2-a045-4b2369dc5da6 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503" status: 404 len: 111 microversion: 2.1 time: 0.031540 Jul 25 19:18:55.213872 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 537/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:55 2022] GET /compute/v2.1/servers/d8cda365-54af-4db5-857e-91948f2d7503 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:18:56.476405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:56.476928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:56.484046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:56.484559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:56.485327 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:56.485863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:56.500014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] HTTP exception thrown: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Request method failure captured: Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 HTTP/1.1 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk4AbZuX7Q1zjRdT0jZiyndCKO5951qSJAXUv82_F9DfMsAC-gxhMzkz-RmvSMPJi_qaBXH7Pz2USW6piei_KvrTtr8vrDR5-YXHgQ-1vZLuIwJCb0ZRGR-jpZ4xanAkONNjGXqzGmhnk9Ea5cTV1J9nURP6puZM5gtSauVtjzLoZ8 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:18:56.501561 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e929654eb2b4c1ca969174e94aa8de2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 592de777b94148b791e18bf898386f34 Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.503687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '4c66e632-dd5c-4eb5-89fb-ddfe319d4046'} Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:18:56.504570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.506054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.507583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Returning 404 to user: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:18:56.507583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-11aa7cc8-69ab-44ee-a0f4-c334646b91e1 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 404 len: 111 microversion: 2.1 time: 0.031224 Jul 25 19:18:56.507583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 514/1051] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:18:56 2022] DELETE /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:18:56.512199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:18:56.512807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] [instance: 4c66e632-dd5c-4eb5-89fb-ddfe319d4046] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:18:56.519932 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:56.520372 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:56.521132 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:18:56.521593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:18:56.535522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] HTTP exception thrown: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Request method failure captured: Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 HTTP/1.1 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk4AbZuX7Q1zjRdT0jZiyndCKO5951qSJAXUv82_F9DfMsAC-gxhMzkz-RmvSMPJi_qaBXH7Pz2USW6piei_KvrTtr8vrDR5-YXHgQ-1vZLuIwJCb0ZRGR-jpZ4xanAkONNjGXqzGmhnk9Ea5cTV1J9nURP6puZM5gtSauVtjzLoZ8 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:18:56.537106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e929654eb2b4c1ca969174e94aa8de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e929654eb2b4c1ca969174e94aa8de2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 5e929654eb2b4c1ca969174e94aa8de2 Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284394580 Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 592de777b94148b791e18bf898386f34 Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeTestJSON-1284394580-project Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.538820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '4c66e632-dd5c-4eb5-89fb-ddfe319d4046'} Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:18:56.539909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. Jul 25 19:18:56.541363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:18:56.542793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] Returning 404 to user: Instance 4c66e632-dd5c-4eb5-89fb-ddfe319d4046 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:18:56.542793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8cb18a85-38ee-4baf-a1a7-e832ac7e3498 tempest-AttachVolumeTestJSON-1284394580 tempest-AttachVolumeTestJSON-1284394580-project] 10.222.0.17 "GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046" status: 404 len: 111 microversion: 2.1 time: 0.030123 Jul 25 19:18:56.542793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 538/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:18:56 2022] GET /compute/v2.1/servers/4c66e632-dd5c-4eb5-89fb-ddfe319d4046 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:19:02.131969 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-8e7060cd-8a6d-40cf-b177-a8efe2227358 req-dc031c88-6102-49b7-a890-0cb7c59d1ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:02.132644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:02.133212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:02.143154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:02.143615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:02.144592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:02.145057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:02.154559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8e7060cd-8a6d-40cf-b177-a8efe2227358 req-dc031c88-6102-49b7-a890-0cb7c59d1ced service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:02.154806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-8e7060cd-8a6d-40cf-b177-a8efe2227358 req-dc031c88-6102-49b7-a890-0cb7c59d1ced service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:02.169714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-8e7060cd-8a6d-40cf-b177-a8efe2227358 req-dc031c88-6102-49b7-a890-0cb7c59d1ced service nova] Creating event network-changed:917d51f6-d780-4f2f-b965-f032f1e24916 for instance 08be3488-9017-42d8-99ed-63e8fe344653 on hv-cinder-82002 Jul 25 19:19:02.175939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-8e7060cd-8a6d-40cf-b177-a8efe2227358 req-dc031c88-6102-49b7-a890-0cb7c59d1ced service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048343 Jul 25 19:19:02.176854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 539/1053] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:02.187545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:19:02.506969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-83adae2e-4c1e-4772-858d-316aeb907510 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 204 len: 0 microversion: 2.1 time: 0.380132 Jul 25 19:19:02.512723 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 515/1054] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:19:02 2022] DELETE /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:19:02.522062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:02.523060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:02.529996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:02.535790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:02.535790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:02.535790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:02.686858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:02.696092 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6e53f8bf-4d85-4240-b2dc-04c349bbb906 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.180496 Jul 25 19:19:02.710400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 540/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:02 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:03.720640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:03.722614 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:03.729597 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:03.729972 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:03.730775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:03.731199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:03.906301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:03.917015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-97e1cc1b-d698-4f35-95ea-547762f13126 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1566 microversion: 2.1 time: 0.200467 Jul 25 19:19:03.917593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 516/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:03 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:04.941191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:04.942827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:04.952391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-22d04b52-d6df-4612-a78f-e80a51c0321f req-c05b3025-6d4c-4564-94e0-97c8d9f6b103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08be3488-9017-42d8-99ed-63e8fe344653", "name": "network-vif-deleted", "tag": "917d51f6-d780-4f2f-b965-f032f1e24916"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:04.962659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-22d04b52-d6df-4612-a78f-e80a51c0321f req-c05b3025-6d4c-4564-94e0-97c8d9f6b103 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:04.965192 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-22d04b52-d6df-4612-a78f-e80a51c0321f req-c05b3025-6d4c-4564-94e0-97c8d9f6b103 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:04.967068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:04.967669 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:04.968466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:04.968901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:04.979537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-22d04b52-d6df-4612-a78f-e80a51c0321f req-c05b3025-6d4c-4564-94e0-97c8d9f6b103 service nova] Creating event network-vif-deleted:917d51f6-d780-4f2f-b965-f032f1e24916 for instance 08be3488-9017-42d8-99ed-63e8fe344653 on hv-cinder-82002 Jul 25 19:19:04.985134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-22d04b52-d6df-4612-a78f-e80a51c0321f req-c05b3025-6d4c-4564-94e0-97c8d9f6b103 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036459 Jul 25 19:19:04.986081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 517/1057] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:05.068992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:05.078545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c23bb8c9-5ea3-440f-8e02-562d72d9491a tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1380 microversion: 2.1 time: 0.141908 Jul 25 19:19:05.079139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 541/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:04 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1380 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:06.102521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:06.103238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:06.112954 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:06.113320 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:06.114091 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:06.114562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:06.153767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:06.159392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:06.159392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lazy-loading 'fault' on Instance uuid 08be3488-9017-42d8-99ed-63e8fe344653 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:19:06.208527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9631ec5df93c42df9d2f60bedfef6507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019f72079acf4a74bd1a0706041e6678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:06.216909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9c932bdd-f2fa-42e9-b90b-f4e5c4d9cd85 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 200 len: 1223 microversion: 2.1 time: 0.119927 Jul 25 19:19:06.217951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 518/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:06 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:07.240044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:07.241265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] [instance: 08be3488-9017-42d8-99ed-63e8fe344653] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:07.248730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:07.251762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:07.251762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:07.251762 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:07.266651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] HTTP exception thrown: Instance 08be3488-9017-42d8-99ed-63e8fe344653 could not be found. Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Request method failure captured: Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 HTTP/1.1 Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3usirYuTOBcooMw7kfrrsomZFiH0h-QxkrEPSbpFImuPunFleJWvYZJwO-5uwY0pRQA3oOr7ge011jKcWB0VAaNmtgx6UzMZVt3xGC6DZLioxHpwbMkw-ygsG9Ufife0R248opCm8LvA7CAcQYaH72bT7WQe2EZ3aDej8Azz7JekW8E Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 019f72079acf4a74bd1a0706041e6678 Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-TestShelveInstance-1921324872 Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:19:07.268833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/019f72079acf4a74bd1a0706041e6678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/019f72079acf4a74bd1a0706041e6678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/019f72079acf4a74bd1a0706041e6678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_019f72079acf4a74bd1a0706041e6678", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-TestShelveInstance-1921324872 Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 019f72079acf4a74bd1a0706041e6678 Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-TestShelveInstance-1921324872 Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-TestShelveInstance-1921324872-project Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 9631ec5df93c42df9d2f60bedfef6507 Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-TestShelveInstance-1921324872-project Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 08be3488-9017-42d8-99ed-63e8fe344653 could not be found. Jul 25 19:19:07.270460 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '08be3488-9017-42d8-99ed-63e8fe344653'} Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08be3488-9017-42d8-99ed-63e8fe344653 could not be found. Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:07.271407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08be3488-9017-42d8-99ed-63e8fe344653 could not be found. Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08be3488-9017-42d8-99ed-63e8fe344653 could not be found. Jul 25 19:19:07.272945 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:07.275064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Returning 404 to user: Instance 08be3488-9017-42d8-99ed-63e8fe344653 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:07.276124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-262ab324-47da-4fe1-97ca-40ca96f41f9b tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653" status: 404 len: 111 microversion: 2.1 time: 0.040239 Jul 25 19:19:07.276692 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 542/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:07 2022] GET /compute/v2.1/servers/08be3488-9017-42d8-99ed-63e8fe344653 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:19:07.876573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-af8a320b-36b7-4a76-aab4-3279f0198bf1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] Calling method '.version_select at 0x7fd8ea331e50>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:08.003683 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-af8a320b-36b7-4a76-aab4-3279f0198bf1 tempest-TestShelveInstance-1921324872 tempest-TestShelveInstance-1921324872-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-502373297" status: 202 len: 0 microversion: 2.1 time: 0.148543 Jul 25 19:19:08.007567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 519/1061] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Jul 25 19:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-502373297 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:19:08.442966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1137c941-396b-455f-a744-541ce6db3b19 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: .version_select at 0x7fd8e5d55e50>, body: {"keypair": {"name": "tempest-keypair-454593952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIgmj8X035M8vHk8MpCrjCfj9r7D7pT2Lhq8GQM4rrak7KwlOx5MmU88hfAmSGp09wMI2UIXv9wW/FRV22DOG/rsRj6/g09FGDa5HOXWkmzlsAV+Of/a1U9Y3FmuhSTxg=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:08.459647 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-1137c941-396b-455f-a744-541ce6db3b19 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:19:08.464178 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-1137c941-396b-455f-a744-541ce6db3b19 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:19:08.539742 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1137c941-396b-455f-a744-541ce6db3b19 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238532 Jul 25 19:19:08.541321 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 543/1062] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:19:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:11.401726 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-408184594", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6364bb15-7d49-4471-b756-05562b7f4867"}], "security_groups": [{"name": "tempest-securitygroup--1820267940"}], "key_name": "tempest-keypair-454593952", "user_data": "}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:11.610383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] validate_networks() for [('6364bb15-7d49-4471-b756-05562b7f4867', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:19:12.452767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:19:12.453566 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:19:12.453690 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:19:12.454382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:19:12.454826 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:19:12.471023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:12.471481 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:12.476089 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:12.476579 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:12.501116 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:19:12.522867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:19:12.552900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:19:12.563617 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:19:12.687042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:19:13.694717 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 37172. Jul 25 19:19:13.699112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f3b374b6-7dee-4271-84ce-457b1b70a4fa tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.319351 Jul 25 19:19:13.699746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 520/1063] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:19:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 2322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:19:13.711368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c735d178-fafa-4dcd-956a-1ca6acb6d186 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:13.711997 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c735d178-fafa-4dcd-956a-1ca6acb6d186 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:13.714486 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:13.818020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c735d178-fafa-4dcd-956a-1ca6acb6d186 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:13.826190 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c735d178-fafa-4dcd-956a-1ca6acb6d186 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1240 microversion: 2.1 time: 0.118760 Jul 25 19:19:13.827190 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 544/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:13 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:14.848122 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c6e99caa-4196-43a6-ace0-807e9a1870d3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:14.848918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c6e99caa-4196-43a6-ace0-807e9a1870d3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:14.914113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c6e99caa-4196-43a6-ace0-807e9a1870d3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:14.926177 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c6e99caa-4196-43a6-ace0-807e9a1870d3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1240 microversion: 2.1 time: 0.082579 Jul 25 19:19:14.929024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 521/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:14 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:15.953998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-43aaaa8c-fcda-436f-9c79-5f20a9fd4300 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:15.956870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-43aaaa8c-fcda-436f-9c79-5f20a9fd4300 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:16.036971 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-43aaaa8c-fcda-436f-9c79-5f20a9fd4300 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:16.050647 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-43aaaa8c-fcda-436f-9c79-5f20a9fd4300 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1240 microversion: 2.1 time: 0.106043 Jul 25 19:19:16.062043 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 545/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:15 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:17.074343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:17.076248 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:17.081431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:17.085349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:17.085806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:17.086617 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:17.087055 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:17.089801 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:17.153447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:17.162747 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-93e25698-65ed-458c-bc6c-880c25895f2c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1244 microversion: 2.1 time: 0.092924 Jul 25 19:19:17.163179 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 522/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:17 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:18.184904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:18.186070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:18.191471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:18.197441 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:18.197803 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:18.198602 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:18.199032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:18.269973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:18.282084 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-73eed132-9fcd-41fa-a6f1-993f87f1e6a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1310 microversion: 2.1 time: 0.097587 Jul 25 19:19:18.282826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 546/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:18 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:19.301671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:19.303211 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:19.311719 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:19.312173 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:19.313028 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:19.313588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:19.521063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:19.528403 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c232b354-27ae-47c4-8556-4115db2512e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.232391 Jul 25 19:19:19.529178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 523/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:19 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:20.038423 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-1e96dd22-41df-47ec-b1b6-6b03cc2b844f req-8bf5d8cc-06c7-49ab-8d53-2e0e46be1daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc78d785-eb78-41fa-a9a2-6c87430ec7b9", "tag": "719a62f5-7567-4db5-af04-a4ceccec5b4e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:20.052937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-1e96dd22-41df-47ec-b1b6-6b03cc2b844f req-8bf5d8cc-06c7-49ab-8d53-2e0e46be1daf service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:20.053471 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-1e96dd22-41df-47ec-b1b6-6b03cc2b844f req-8bf5d8cc-06c7-49ab-8d53-2e0e46be1daf service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:20.066744 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-1e96dd22-41df-47ec-b1b6-6b03cc2b844f req-8bf5d8cc-06c7-49ab-8d53-2e0e46be1daf service nova] Creating event network-changed:719a62f5-7567-4db5-af04-a4ceccec5b4e for instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 on hv-cinder-82002 Jul 25 19:19:20.072721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-1e96dd22-41df-47ec-b1b6-6b03cc2b844f req-8bf5d8cc-06c7-49ab-8d53-2e0e46be1daf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043912 Jul 25 19:19:20.077926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 547/1070] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:20.553143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:20.553745 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:20.562595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:20.563168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:20.563946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:20.564921 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:20.777454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:20.785440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f9628425-e488-43f3-ac1d-8187d0693e46 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.236249 Jul 25 19:19:20.786104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 524/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:20 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:21.806874 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:21.807579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:21.816069 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:21.816513 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:21.817289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:21.817718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:21.958589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:21.966425 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2640e173-2253-40e5-a7ab-84f2dfd5b0e0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.163767 Jul 25 19:19:21.967045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 548/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:21 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:19:22.987691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:22.988299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:22.990821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:22.996061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:22.996599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:22.997276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:22.997711 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:23.129396 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:23.137037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-feab6dfa-6922-45a3-8772-9a32ed203f31 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.153274 Jul 25 19:19:23.137602 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 525/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:22 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:24.158947 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:24.159619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:24.165958 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:24.166434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:24.167204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:24.167639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:24.304408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:24.311833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d3b9d904-59e8-41e6-9016-78d036636fe6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.156926 Jul 25 19:19:24.312396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 549/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:24 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:25.333256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:25.333849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:25.336184 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=8 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:25.341052 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:25.341500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:25.342278 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:25.342740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:25.485168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:25.493078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-286ed255-e960-4cc6-ba1f-d38095430a6f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.164339 Jul 25 19:19:25.493644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 526/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:25 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:25.781075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-cf48d25c-df4a-41a3-b4c5-0c8b0317365f req-ff739949-7f30-406f-81aa-da2763fabc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc78d785-eb78-41fa-a9a2-6c87430ec7b9", "name": "network-vif-plugged", "status": "completed", "tag": "719a62f5-7567-4db5-af04-a4ceccec5b4e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:25.791772 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-cf48d25c-df4a-41a3-b4c5-0c8b0317365f req-ff739949-7f30-406f-81aa-da2763fabc62 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:25.792224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-cf48d25c-df4a-41a3-b4c5-0c8b0317365f req-ff739949-7f30-406f-81aa-da2763fabc62 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:25.805000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-cf48d25c-df4a-41a3-b4c5-0c8b0317365f req-ff739949-7f30-406f-81aa-da2763fabc62 service nova] Creating event network-vif-plugged:719a62f5-7567-4db5-af04-a4ceccec5b4e for instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 on hv-cinder-82002 Jul 25 19:19:25.810126 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-cf48d25c-df4a-41a3-b4c5-0c8b0317365f req-ff739949-7f30-406f-81aa-da2763fabc62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 Jul 25 19:19:25.810946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 550/1076] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:26.513112 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:26.513730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:26.520471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:26.520925 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:26.521695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:26.522130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:26.663414 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:26.672427 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-09ba3faa-91c6-439a-88c7-7ef4bbd7f8f1 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.161669 Jul 25 19:19:26.672427 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 527/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:26 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:27.693369 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:27.694125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:27.696687 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=8 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:27.702262 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:27.702747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:27.703564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:27.703995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:27.844906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:27.852689 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f160b682-f1ae-4a05-a0f9-ebc6d0927e2a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1366 microversion: 2.1 time: 0.163617 Jul 25 19:19:27.853264 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 551/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:27 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:28.873856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:28.874535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:28.882152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:28.882570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:28.883342 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:28.883777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:29.015819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:29.023938 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5322c9f0-5fe0-4192-9aa2-72cbb161f84f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1557 microversion: 2.1 time: 0.154138 Jul 25 19:19:29.024500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 528/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:19:28 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:19:29.045103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:29.045671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:29.052538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:29.052985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:29.053753 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:29.054188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:29.133674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3181149e-5904-4837-988f-49ede0d75325 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092837 Jul 25 19:19:29.134270 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 552/1080] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:19:29 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:29.923884 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:29.926949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:29.933613 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:29.934502 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:29.934983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:29.935402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:29.965737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-851e95aa-8d69-435e-a9e8-4e77f6316f14 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045887 Jul 25 19:19:29.966319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 529/1081] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Jul 25 19:19:29 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:19:30.038862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:30.039353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:30.045407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:30.046012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:30.046616 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:30.047052 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:30.074384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:19:30.378172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e33f37cf-39e1-474a-ad8c-a91fb5d3a369 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 204 len: 0 microversion: 2.20 time: 0.342733 Jul 25 19:19:30.378735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 553/1082] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Jul 25 19:19:30 2022] DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 19:19:30.387508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:30.392331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:30.394600 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:30.395054 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:30.395831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:30.396269 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:30.441308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-68aea771-ce22-4fc8-b2e2-be3462510627 req-20771e96-6fe2-40b8-a0d3-ad1b202e06a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc78d785-eb78-41fa-a9a2-6c87430ec7b9", "tag": "719a62f5-7567-4db5-af04-a4ceccec5b4e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:30.451027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-68aea771-ce22-4fc8-b2e2-be3462510627 req-20771e96-6fe2-40b8-a0d3-ad1b202e06a9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:30.451572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-68aea771-ce22-4fc8-b2e2-be3462510627 req-20771e96-6fe2-40b8-a0d3-ad1b202e06a9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:30.464050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-68aea771-ce22-4fc8-b2e2-be3462510627 req-20771e96-6fe2-40b8-a0d3-ad1b202e06a9 service nova] Creating event network-changed:719a62f5-7567-4db5-af04-a4ceccec5b4e for instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 on hv-cinder-82002 Jul 25 19:19:30.469134 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-68aea771-ce22-4fc8-b2e2-be3462510627 req-20771e96-6fe2-40b8-a0d3-ad1b202e06a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032442 Jul 25 19:19:30.469994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 554/1083] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:19:30.543719 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:30.552665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:30.554157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:30.555344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bd082500-f4d3-47ce-b505-12fb97ffa1d4 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.171833 Jul 25 19:19:30.555896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 530/1084] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:30 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:19:31.583389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:31.584095 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:31.590700 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:31.591126 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:31.591906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:31.592342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:31.731328 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:31.739565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:31.741338 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:31.742588 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f050b988-ddb6-4bd1-9738-d632aff496b5 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1725 microversion: 2.20 time: 0.164647 Jul 25 19:19:31.743152 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 555/1085] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:31 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:19:32.767737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:32.769119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:32.775769 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:32.776234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:32.777069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:32.777513 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:32.852806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:32.861057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:32.862605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:32.863746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c34c65e0-b66b-4491-9d7f-eed74e46e76f tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1657 microversion: 2.20 time: 0.100756 Jul 25 19:19:32.864294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 531/1086] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:32 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1657 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:19:33.072809 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-9ef7401b-070c-4df6-85cc-ace0f57dd16a req-73dc52cc-ff3d-48c0-8e63-54b775ea4779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a409929-a0ff-4350-9df3-2d2e7e0b3b5d", "name": "network-vif-deleted", "tag": "8385cd76-848d-480a-b3bc-e88f1a2334fd"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:33.082884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-9ef7401b-070c-4df6-85cc-ace0f57dd16a req-73dc52cc-ff3d-48c0-8e63-54b775ea4779 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:33.083729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-9ef7401b-070c-4df6-85cc-ace0f57dd16a req-73dc52cc-ff3d-48c0-8e63-54b775ea4779 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:33.094664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-9ef7401b-070c-4df6-85cc-ace0f57dd16a req-73dc52cc-ff3d-48c0-8e63-54b775ea4779 service nova] Creating event network-vif-deleted:8385cd76-848d-480a-b3bc-e88f1a2334fd for instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d on hv-cinder-82002 Jul 25 19:19:33.099734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-9ef7401b-070c-4df6-85cc-ace0f57dd16a req-73dc52cc-ff3d-48c0-8e63-54b775ea4779 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 Jul 25 19:19:33.100317 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 556/1087] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:33.887578 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:33.888139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:33.895587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:33.896041 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:33.896805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:33.897251 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:33.937464 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:33.938706 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:33.940363 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lazy-loading 'fault' on Instance uuid 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:19:33.990414 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:33.999957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:34.001494 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c99e02a845184f0aa206ba9f209ae4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2de35c4252b4a6fa55eb7e5d59e06cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:19:34.003477 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7c056188-b0fb-4287-82e1-4b84f247da79 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 200 len: 1372 microversion: 2.20 time: 0.119874 Jul 25 19:19:34.004121 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 532/1088] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:33 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:19:35.038298 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:35.039037 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:35.045284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:35.045734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:35.046528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:35.046964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:35.061054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] HTTP exception thrown: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Request method failure captured: Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d HTTP/1.1 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk9gOYZ_mCIxXMCOP3QV5r4F_qttyP-qXdcK8jaV1TLRcsmzpGG-RGIMIq_H5yNNz6eXjFVNialntmqHw1lE1iziuYG1DBTu73NBglFIkQf7fxKHaI5LdxUgNyUbDzvNfEClMemJqSsdwzLZ3rw4jO0lycUCB6sSYHId2XVeJa9eC0 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:19:35.062730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2de35c4252b4a6fa55eb7e5d59e06cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: c99e02a845184f0aa206ba9f209ae4ef Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:35.064472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '4a409929-a0ff-4350-9df3-2d2e7e0b3b5d'} Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:35.065508 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:35.067267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:35.068906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Returning 404 to user: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:35.068906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-03b07968-43aa-4704-a319-f3f0636ac7d2 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 404 len: 111 microversion: 2.20 time: 0.031426 Jul 25 19:19:35.068906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 557/1089] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:35 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:19:35.073442 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-43b96fb6-d1b0-4be8-ae04-1ef21cffc1d8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '.version_select at 0x7fd8ea3f3790>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:35.150413 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-43b96fb6-d1b0-4be8-ae04-1ef21cffc1d8 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562545289" status: 204 len: 0 microversion: 2.20 time: 0.080741 Jul 25 19:19:35.151002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 533/1090] 10.222.0.17 () {60 vars in 1262 bytes} [Mon Jul 25 19:19:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562545289 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 19:19:37.294617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:37.295149 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:37.301844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:37.302289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:37.303078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:37.303506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:37.317867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] HTTP exception thrown: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Request method failure captured: Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d HTTP/1.1 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk9gOYZ_mCIxXMCOP3QV5r4F_qttyP-qXdcK8jaV1TLRcsmzpGG-RGIMIq_H5yNNz6eXjFVNialntmqHw1lE1iziuYG1DBTu73NBglFIkQf7fxKHaI5LdxUgNyUbDzvNfEClMemJqSsdwzLZ3rw4jO0lycUCB6sSYHId2XVeJa9eC0 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:19:37.319509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2de35c4252b4a6fa55eb7e5d59e06cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: c99e02a845184f0aa206ba9f209ae4ef Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.321209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '4a409929-a0ff-4350-9df3-2d2e7e0b3b5d'} Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:37.322164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.323739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.325242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Returning 404 to user: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:37.325242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-205a189a-9c54-4e27-a9c2-1fd15362d27d tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 404 len: 111 microversion: 2.20 time: 0.030526 Jul 25 19:19:37.325242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 558/1091] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Jul 25 19:19:37 2022] DELETE /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:19:37.330256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:37.330948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:37.338193 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:37.338668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:37.339435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:37.339869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:37.353099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] HTTP exception thrown: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Request method failure captured: Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d HTTP/1.1 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk9gOYZ_mCIxXMCOP3QV5r4F_qttyP-qXdcK8jaV1TLRcsmzpGG-RGIMIq_H5yNNz6eXjFVNialntmqHw1lE1iziuYG1DBTu73NBglFIkQf7fxKHaI5LdxUgNyUbDzvNfEClMemJqSsdwzLZ3rw4jO0lycUCB6sSYHId2XVeJa9eC0 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:19:37.354829 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2de35c4252b4a6fa55eb7e5d59e06cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: c99e02a845184f0aa206ba9f209ae4ef Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.356505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '4a409929-a0ff-4350-9df3-2d2e7e0b3b5d'} Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:37.357536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. Jul 25 19:19:37.358838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:37.360034 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Returning 404 to user: Instance 4a409929-a0ff-4350-9df3-2d2e7e0b3b5d could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:37.360034 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c4cf2976-0462-4822-b5ee-da9dbc3b3718 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d" status: 404 len: 111 microversion: 2.20 time: 0.030563 Jul 25 19:19:37.360034 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 534/1092] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:37 2022] GET /compute/v2.1/servers/4a409929-a0ff-4350-9df3-2d2e7e0b3b5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:19:38.660199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:38.660788 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:38.667646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:38.668092 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:38.668864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:38.669302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:38.683278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] HTTP exception thrown: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Request method failure captured: Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de HTTP/1.1 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uk9gOYZ_mCIxXMCOP3QV5r4F_qttyP-qXdcK8jaV1TLRcsmzpGG-RGIMIq_H5yNNz6eXjFVNialntmqHw1lE1iziuYG1DBTu73NBglFIkQf7fxKHaI5LdxUgNyUbDzvNfEClMemJqSsdwzLZ3rw4jO0lycUCB6sSYHId2XVeJa9eC0 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:19:38.684839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2de35c4252b4a6fa55eb7e5d59e06cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: c99e02a845184f0aa206ba9f209ae4ef Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.686543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '455a6d7b-3a62-47e8-8eca-526bc28307de'} Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:38.687523 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.689106 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.690592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Returning 404 to user: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:38.690592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-240d55bd-95ec-4248-bac9-983b1acb4108 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 404 len: 111 microversion: 2.20 time: 0.030626 Jul 25 19:19:38.690592 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 559/1093] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Jul 25 19:19:38 2022] DELETE /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:19:38.695128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:38.695775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] [instance: 455a6d7b-3a62-47e8-8eca-526bc28307de] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:19:38.702299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:38.702777 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:38.703545 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:19:38.703982 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:19:38.717354 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] HTTP exception thrown: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Request method failure captured: Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de HTTP/1.1 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uk9gOYZ_mCIxXMCOP3QV5r4F_qttyP-qXdcK8jaV1TLRcsmzpGG-RGIMIq_H5yNNz6eXjFVNialntmqHw1lE1iziuYG1DBTu73NBglFIkQf7fxKHaI5LdxUgNyUbDzvNfEClMemJqSsdwzLZ3rw4jO0lycUCB6sSYHId2XVeJa9eC0 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:19:38.718937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2de35c4252b4a6fa55eb7e5d59e06cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2de35c4252b4a6fa55eb7e5d59e06cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c2de35c4252b4a6fa55eb7e5d59e06cf Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92691636 Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: c99e02a845184f0aa206ba9f209ae4ef Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92691636-project Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.720562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '455a6d7b-3a62-47e8-8eca-526bc28307de'} Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:38.722083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. Jul 25 19:19:38.723669 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:19:38.724937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] Returning 404 to user: Instance 455a6d7b-3a62-47e8-8eca-526bc28307de could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:38.724937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3a3d8faf-a29f-47e5-ac75-a6ef40b2e796 tempest-AttachVolumeShelveTestJSON-92691636 tempest-AttachVolumeShelveTestJSON-92691636-project] 10.222.0.17 "GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de" status: 404 len: 111 microversion: 2.20 time: 0.029263 Jul 25 19:19:38.724937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 535/1094] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Jul 25 19:19:38 2022] GET /compute/v2.1/servers/455a6d7b-3a62-47e8-8eca-526bc28307de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:19:44.665236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9139e404-037b-4032-b415-a36d2d8f836d tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Action: 'create', calling method: .version_select at 0x7fd8e5c34790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1706375370", "metadata": {"Type": "work"}}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:19:45.304187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9139e404-037b-4032-b415-a36d2d8f836d tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.759228 Jul 25 19:19:45.304828 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 560/1095] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Jul 25 19:19:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 761 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 19:19:45.318484 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e9616809-bb67-49c4-9670-1d070815909b tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Calling method '.version_select at 0x7fd8e68eeee0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:45.372391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e9616809-bb67-49c4-9670-1d070815909b tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109" status: 200 len: 353 microversion: 2.1 time: 0.058304 Jul 25 19:19:45.379492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 536/1096] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:19:45 2022] GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:46.388037 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dcf89134-6718-4082-9af5-f99b35ea381c tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Calling method '.version_select at 0x7fd8e5eb6a60>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:46.438920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dcf89134-6718-4082-9af5-f99b35ea381c tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109" status: 200 len: 354 microversion: 2.1 time: 0.055451 Jul 25 19:19:46.439506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 561/1097] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:19:46 2022] GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:46.453104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-05725d40-17cb-4d55-b067-41c343ac20ca tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Calling method '.version_select at 0x7fd8e584a280>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:46.501496 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-05725d40-17cb-4d55-b067-41c343ac20ca tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109" status: 200 len: 354 microversion: 2.1 time: 0.052717 Jul 25 19:19:46.502109 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 537/1098] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:19:46 2022] GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:19:46.520025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6c67332f-7853-4665-8f0f-853b7183311e tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Calling method '.version_select at 0x7fd8e6039ca0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:46.709211 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6c67332f-7853-4665-8f0f-853b7183311e tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109" status: 202 len: 0 microversion: 2.1 time: 0.193496 Jul 25 19:19:46.709735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 562/1099] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:19:46 2022] DELETE /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:19:46.718006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bf5b06ad-1cec-45ca-9ef0-9df728e20a55 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Calling method '.version_select at 0x7fd8ea41a9d0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:46.766812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bf5b06ad-1cec-45ca-9ef0-9df728e20a55 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109" status: 200 len: 353 microversion: 2.1 time: 0.052613 Jul 25 19:19:46.767473 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 538/1100] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:19:46 2022] GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:19:47.782060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a5fedbe6-6469-4a88-bebe-9b934c8fa2a2 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Calling method '.version_select at 0x7fd8e5edb310>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:19:47.810932 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-a5fedbe6-6469-4a88-bebe-9b934c8fa2a2 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] HTTP exception thrown: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a5fedbe6-6469-4a88-bebe-9b934c8fa2a2 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Request method failure captured: Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 HTTP/1.1 Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uzQGwi2BGZyl8v9_0OiUQPOanVC40j8SojHbaKRPorr_tjfnWlkD8gesW2bsKuIrxa4V78X3P5JJzzeeXUkN9Q82P2764QW8i2usxo_Fc4gHIi_wefcoFIIsYJp8eIwnhLmt7-Ps3hi5NQB_kr1udc98qL0rKWEXfUhXBe-Q9IwPKU Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 6df3ad763ab140198487b1a2aff4f84c Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-VolumesGetTestJSON-841046210 Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:19:47.812920 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6df3ad763ab140198487b1a2aff4f84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6df3ad763ab140198487b1a2aff4f84c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6df3ad763ab140198487b1a2aff4f84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6df3ad763ab140198487b1a2aff4f84c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-VolumesGetTestJSON-841046210 Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 6df3ad763ab140198487b1a2aff4f84c Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-VolumesGetTestJSON-841046210 Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-VolumesGetTestJSON-841046210-project Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: d48dc57c038c479a94167fddac7bd7c2 Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-VolumesGetTestJSON-841046210-project Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '71849fac-19d4-4772-ab04-2a3d15b0e109'} Jul 25 19:19:47.814774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. (HTTP 404) (Request-ID: req-a16e9e51-71c6-4813-819c-749292086437) Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:47.815849 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 19:19:47.817314 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 19:19:47.818909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a5fedbe6-6469-4a88-bebe-9b934c8fa2a2 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] Returning 404 to user: Volume 71849fac-19d4-4772-ab04-2a3d15b0e109 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a5fedbe6-6469-4a88-bebe-9b934c8fa2a2 tempest-VolumesGetTestJSON-841046210 tempest-VolumesGetTestJSON-841046210-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109" status: 404 len: 109 microversion: 2.1 time: 0.036772 Jul 25 19:19:47.820344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 563/1101] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Jul 25 19:19:47 2022] GET /compute/v2.1/os-volumes/71849fac-19d4-4772-ab04-2a3d15b0e109 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:21:12.988525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:12.989559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=71 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:12.993902 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:12.994432 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:13.001285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:13.001744 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:13.002560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:13.003006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:13.026612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-db6088b8-f8e5-469e-b836-b880be19215a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/ips" status: 200 len: 151 microversion: 2.1 time: 0.040076 Jul 25 19:21:13.027185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 539/1102] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:21:12 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:21:15.973905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:15.974714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:15.979876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c7a4c7b-843f-4132-aa55-3f53197ceb5d"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:21:15.982203 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:15.991464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:15.991464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:15.991464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:15.991464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:16.085614 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:21:16.085881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:21:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments (ip 10.222.0.17) !!! Jul 25 19:21:17.069422 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-21c6e8de-fcad-45ce-b46d-1e93965df9e3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098989 Jul 25 19:21:17.070104 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 564/1103] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:21:15 2022] POST /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments => generated 194 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:21:33.123347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d0a7579d-a784-49ca-b2d1-40c894b543c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: .version_select at 0x7fd8ea3e3af0>, body: {"keypair": {"name": "tempest-keypair-959018074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPugWt7ZWiBxogksLX+8AVnXa4DGhFRa8UmQxoiIsebMldCZ+4I/cP+R4g4fSoD/L8OPHArWdKydk7DiuysR5GH4Sh0sya7gu9l5Vcz+aZkmYEqAetcz0Ex1wz3zNBqyvQ=="}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:21:33.144264 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-d0a7579d-a784-49ca-b2d1-40c894b543c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:21:33.151061 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-d0a7579d-a784-49ca-b2d1-40c894b543c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:21:33.237670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d0a7579d-a784-49ca-b2d1-40c894b543c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118239 Jul 25 19:21:33.238279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 540/1104] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:21:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:21:35.988219 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:35.989380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:35.994664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-171043956", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6364bb15-7d49-4471-b756-05562b7f4867"}], "security_groups": [{"name": "tempest-securitygroup--473923173"}], "key_name": "tempest-keypair-959018074", "user_data": "}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:21:36.126970 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] validate_networks() for [('6364bb15-7d49-4471-b756-05562b7f4867', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:21:36.637925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:21:36.638374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:21:36.638861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:21:36.639299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:21:36.639760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:21:36.650634 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:36.651024 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:36.651863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:36.652348 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:36.673991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:21:36.679635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:21:36.692133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:21:36.694576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:21:36.964831 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1007c248-e2ff-4922-acfa-702234049b8d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.978064 Jul 25 19:21:36.965481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 565/1105] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:21:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:21:36.977145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e8a51e1d-1d57-4c13-8ff1-51729882ea3c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:36.977832 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e8a51e1d-1d57-4c13-8ff1-51729882ea3c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:37.156338 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e8a51e1d-1d57-4c13-8ff1-51729882ea3c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:37.165119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e8a51e1d-1d57-4c13-8ff1-51729882ea3c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1240 microversion: 2.1 time: 0.192252 Jul 25 19:21:37.165900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 541/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:36 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1240 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:38.190298 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:38.190941 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:38.198190 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:38.198664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:38.199437 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:38.199873 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:38.271183 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:38.278794 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c90492a0-8a69-4a9e-af07-45806ee0adf7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1244 microversion: 2.1 time: 0.093596 Jul 25 19:21:38.279358 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 566/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:38 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:39.300501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:39.301111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:39.307734 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:39.311525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:39.311525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:39.311525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:39.377006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:39.384569 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c40ac38b-72a7-4433-ab7f-0f9004973aaf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1292 microversion: 2.1 time: 0.088506 Jul 25 19:21:39.385144 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 542/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:39 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:40.405190 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:40.405911 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:40.412776 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:40.413222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:40.413996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:40.414476 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:40.691581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:40.699008 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-93947bf3-d503-40dd-acd1-92a956ba7902 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.297772 Jul 25 19:21:40.699579 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 567/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:40 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:41.326589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-3f0f7483-44e8-4844-a2cc-d8fa8811baa2 req-b89a991b-4d76-4b92-aaa2-fbc7f4b603aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15608567-7691-4662-ae63-1f4c209689dd", "tag": "a0bd5e7b-6cf9-4b53-aa47-d2317075769d"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:21:41.342633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-3f0f7483-44e8-4844-a2cc-d8fa8811baa2 req-b89a991b-4d76-4b92-aaa2-fbc7f4b603aa service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:41.343339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-3f0f7483-44e8-4844-a2cc-d8fa8811baa2 req-b89a991b-4d76-4b92-aaa2-fbc7f4b603aa service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:41.358159 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-3f0f7483-44e8-4844-a2cc-d8fa8811baa2 req-b89a991b-4d76-4b92-aaa2-fbc7f4b603aa service nova] Creating event network-changed:a0bd5e7b-6cf9-4b53-aa47-d2317075769d for instance 15608567-7691-4662-ae63-1f4c209689dd on hv-cinder-82002 Jul 25 19:21:41.364046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-3f0f7483-44e8-4844-a2cc-d8fa8811baa2 req-b89a991b-4d76-4b92-aaa2-fbc7f4b603aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125628 Jul 25 19:21:41.364654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 543/1110] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:21:41.721032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:41.721655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:41.729046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:41.729501 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:41.730363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:41.730807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:41.896066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:41.904094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ed012fda-fdcb-4c43-9e63-d1595f39c8ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.187215 Jul 25 19:21:41.904664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 568/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:41 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:21:42.927294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:42.927917 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:42.934295 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:42.934788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:42.935563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:42.936004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:43.079247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:43.088373 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8c6ffe9c-cdb7-447f-86e7-e27caa459621 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.165916 Jul 25 19:21:43.088975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 544/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:42 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:44.111010 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:44.111705 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:44.118663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:44.119111 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:44.119883 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:44.120315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:44.262228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:44.270248 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f927f0b9-198a-4a51-bff7-91b70b60b338 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.163974 Jul 25 19:21:44.270869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 569/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:44 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:45.292787 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:45.293523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:45.301142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:45.301142 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:45.304295 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:45.304295 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:45.460724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:45.469066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9d074b6f-4d81-463e-aa4c-0462116db654 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.180908 Jul 25 19:21:45.469661 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 545/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:45 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:46.491640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:46.492295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:46.502392 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:46.502844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:46.503631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:46.504295 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:46.649050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:46.654303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b0abcdad-cf73-4d18-8a05-bad9870a5949 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.166800 Jul 25 19:21:46.654901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 570/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:46 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:47.675779 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:47.676382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:47.678837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:47.683833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:47.684274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:47.685040 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:47.685474 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:47.821350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:47.829475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-035ada38-5076-4f92-8c0e-0528a9670827 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.157567 Jul 25 19:21:47.830050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 546/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:47 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:48.350919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:48.351829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:48.413869 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-c6ac1577-7606-495b-85cc-de942840e3b4 req-80ae0073-6bcb-4203-b3ff-f0991dd69e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15608567-7691-4662-ae63-1f4c209689dd", "name": "network-vif-plugged", "status": "completed", "tag": "a0bd5e7b-6cf9-4b53-aa47-d2317075769d"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:21:48.426025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-c6ac1577-7606-495b-85cc-de942840e3b4 req-80ae0073-6bcb-4203-b3ff-f0991dd69e7d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:48.426894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-c6ac1577-7606-495b-85cc-de942840e3b4 req-80ae0073-6bcb-4203-b3ff-f0991dd69e7d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:48.441981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-c6ac1577-7606-495b-85cc-de942840e3b4 req-80ae0073-6bcb-4203-b3ff-f0991dd69e7d service nova] Creating event network-vif-plugged:a0bd5e7b-6cf9-4b53-aa47-d2317075769d for instance 15608567-7691-4662-ae63-1f4c209689dd on hv-cinder-82002 Jul 25 19:21:48.457675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-c6ac1577-7606-495b-85cc-de942840e3b4 req-80ae0073-6bcb-4203-b3ff-f0991dd69e7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100551 Jul 25 19:21:48.457675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 571/1117] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:21:48.852051 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:48.852710 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:48.860226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:48.860674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:48.861433 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:48.861861 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:49.000356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:49.008447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0be68780-dd64-49d7-a879-d56003b69fec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.160368 Jul 25 19:21:49.009042 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 547/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:48 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:21:50.032230 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:50.032996 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:50.042412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:50.042867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:50.043655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:50.044093 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:50.197003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:50.205191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d5a95fc2-5a0d-40fe-ac1a-cc3968119220 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1365 microversion: 2.1 time: 0.178607 Jul 25 19:21:50.205766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 572/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:50 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:21:51.227802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:51.228438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:51.235996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:51.236445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:51.237209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:51.237668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:51.376979 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:21:51.384791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ef343b25-216f-4ec7-b4e2-81d6c5f73d8f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1555 microversion: 2.1 time: 0.161331 Jul 25 19:21:51.385370 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 548/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:21:51 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:21:51.423410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:21:51.423410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:21:51.423410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:51.423410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:51.424615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:51.424615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:51.498722 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-47ecdd49-557b-494d-a9d9-681aa09318a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097713 Jul 25 19:21:51.499352 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 573/1121] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:21:51 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:21:52.885113 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-692aba2f-7de8-495a-8b03-2e17294350e8 req-f6164ae8-7e7e-4434-9fd3-092e84ff25b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15608567-7691-4662-ae63-1f4c209689dd", "tag": "a0bd5e7b-6cf9-4b53-aa47-d2317075769d"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:21:52.895948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-692aba2f-7de8-495a-8b03-2e17294350e8 req-f6164ae8-7e7e-4434-9fd3-092e84ff25b9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:21:52.896389 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-692aba2f-7de8-495a-8b03-2e17294350e8 req-f6164ae8-7e7e-4434-9fd3-092e84ff25b9 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:21:52.908889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-692aba2f-7de8-495a-8b03-2e17294350e8 req-f6164ae8-7e7e-4434-9fd3-092e84ff25b9 service nova] Creating event network-changed:a0bd5e7b-6cf9-4b53-aa47-d2317075769d for instance 15608567-7691-4662-ae63-1f4c209689dd on hv-cinder-82002 Jul 25 19:21:52.914852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-692aba2f-7de8-495a-8b03-2e17294350e8 req-f6164ae8-7e7e-4434-9fd3-092e84ff25b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Jul 25 19:21:52.915983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 549/1122] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:35.220980 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 19:23:35.220980 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:35.221701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=44 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:35.225980 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:35.226533 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:35.232527 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.237114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.237114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.237114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.259558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8f5066d4-3f35-4829-ae16-2620efad7a15 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/ips" status: 200 len: 149 microversion: 2.1 time: 0.041141 Jul 25 19:23:35.263878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 574/1123] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:23:35 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:35.270727 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:35.271557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=44 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:35.275735 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c7a4c7b-843f-4132-aa55-3f53197ceb5d"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:23:35.278315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:35.284857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.286789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.286789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.286789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.374715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Invalid volume: volume 5c7a4c7b-843f-4132-aa55-3f53197ceb5d is already attached to instances: fc78d785-eb78-41fa-a9a2-6c87430ec7b9 Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: POST /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/os-volume_attachments HTTP/1.1 Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 74 Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:23:35.376479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {"volumeAttachment": {"volumeId": "5c7a4c7b-843f-4132-aa55-3f53197ceb5d"}} Jul 25 19:23:35.378216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Invalid volume: volume 5c7a4c7b-843f-4132-aa55-3f53197ceb5d is already attached to instances: fc78d785-eb78-41fa-a9a2-6c87430ec7b9 Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'server_id': '15608567-7691-4662-ae63-1f4c209689dd', 'body': {'volumeAttachment': {'volumeId': '5c7a4c7b-843f-4132-aa55-3f53197ceb5d'}}} Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5c7a4c7b-843f-4132-aa55-3f53197ceb5d is already attached to instances: fc78d785-eb78-41fa-a9a2-6c87430ec7b9 Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:23:35.379423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5c7a4c7b-843f-4132-aa55-3f53197ceb5d is already attached to instances: fc78d785-eb78-41fa-a9a2-6c87430ec7b9 Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:35.381036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5c7a4c7b-843f-4132-aa55-3f53197ceb5d is already attached to instances: fc78d785-eb78-41fa-a9a2-6c87430ec7b9 Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 400 to user: Invalid volume: volume 5c7a4c7b-843f-4132-aa55-3f53197ceb5d is already attached to instances: fc78d785-eb78-41fa-a9a2-6c87430ec7b9 {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4c1e71e8-85bb-4463-9eb2-5068d5915fe2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109165 Jul 25 19:23:35.382791 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 550/1124] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:23:35 2022] POST /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:23:35.387130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:35.387661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:35.395389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.401039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.401039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.401039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.429532 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:23:35.804424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6b136332-d7f8-446d-8402-11a1b4740a78 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 204 len: 0 microversion: 2.1 time: 0.421103 Jul 25 19:23:35.805012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 575/1125] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:23:35 2022] DELETE /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:23:35.814688 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:35.815302 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:35.822685 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.823137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.824181 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:35.824623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:35.997151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:36.006818 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6cda8ada-83cd-4960-b5ed-cb7b15fc68c5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1679 microversion: 2.1 time: 0.196690 Jul 25 19:23:36.007479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 551/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:35 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:37.032449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:37.033206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:37.048061 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:37.048509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:37.049299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:37.049761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:37.056113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38410. Jul 25 19:23:37.241635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:37.252233 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-33c49624-db27-43ec-aee6-a0842a974673 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1679 microversion: 2.1 time: 0.225778 Jul 25 19:23:37.253070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 576/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:37 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:38.278536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:38.280287 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:38.290230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:38.290725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:38.291525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:38.291964 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:38.372598 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:38.381173 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b998254b-e5c6-468c-b4c9-0f1a3b212e36 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1612 microversion: 2.1 time: 0.108546 Jul 25 19:23:38.381800 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 552/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:38 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:23:38.580784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-fe2c3a6b-5863-4a78-b121-8c207ba06048 req-ef06fd70-c556-42b9-8dac-828f5b3bf9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15608567-7691-4662-ae63-1f4c209689dd", "name": "network-vif-deleted", "tag": "a0bd5e7b-6cf9-4b53-aa47-d2317075769d"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:23:38.600937 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-fe2c3a6b-5863-4a78-b121-8c207ba06048 req-ef06fd70-c556-42b9-8dac-828f5b3bf9d2 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:38.602795 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-fe2c3a6b-5863-4a78-b121-8c207ba06048 req-ef06fd70-c556-42b9-8dac-828f5b3bf9d2 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:38.625252 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-fe2c3a6b-5863-4a78-b121-8c207ba06048 req-ef06fd70-c556-42b9-8dac-828f5b3bf9d2 service nova] Creating event network-vif-deleted:a0bd5e7b-6cf9-4b53-aa47-d2317075769d for instance 15608567-7691-4662-ae63-1f4c209689dd on hv-cinder-82002 Jul 25 19:23:38.635462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-fe2c3a6b-5863-4a78-b121-8c207ba06048 req-ef06fd70-c556-42b9-8dac-828f5b3bf9d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060772 Jul 25 19:23:38.637023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 577/1129] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:39.409409 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:39.410281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:39.419729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:39.419729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:39.421368 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:39.421368 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:39.464402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:39.464852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:39.465314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'fault' on Instance uuid 15608567-7691-4662-ae63-1f4c209689dd {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:23:39.512025 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:39.520831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-34727178-b1f7-4a34-9c16-ca4bd3526867 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 200 len: 1330 microversion: 2.1 time: 0.117696 Jul 25 19:23:39.521421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 553/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:39 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:40.552140 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:40.552793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:40.559203 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:40.559655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:40.560433 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:40.561565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:40.575796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd HTTP/1.1 Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:23:40.578109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:23:40.579720 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '15608567-7691-4662-ae63-1f4c209689dd'} Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:23:40.580635 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:23:40.582395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:40.584332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:23:40.584332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cb612cee-b122-4d69-b819-d5093e4d9a9c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 404 len: 111 microversion: 2.1 time: 0.035543 Jul 25 19:23:40.584332 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 578/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:40 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:23:40.589018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7d3bc9c9-19ee-436e-abda-8c9943e5a386 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '.version_select at 0x7fd8ea41a9d0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:40.674693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7d3bc9c9-19ee-436e-abda-8c9943e5a386 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959018074" status: 202 len: 0 microversion: 2.1 time: 0.089503 Jul 25 19:23:40.676064 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 554/1132] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Jul 25 19:23:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959018074 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:23:41.609820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:41.610468 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:41.617525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:41.617962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:41.618777 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:41.619202 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:41.709564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'services' on Instance uuid fc78d785-eb78-41fa-a9a2-6c87430ec7b9 {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:23:41.970954 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9ccc6e9a-0a16-4552-89fe-9c3504ba79a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments/5c7a4c7b-843f-4132-aa55-3f53197ceb5d" status: 202 len: 0 microversion: 2.1 time: 0.365341 Jul 25 19:23:41.971547 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 579/1133] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:23:41 2022] DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments/5c7a4c7b-843f-4132-aa55-3f53197ceb5d => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:23:41.982974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:41.985320 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:41.993395 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:41.996032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:41.996032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:41.996032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:42.027382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-95a86079-b3fe-4692-aed1-32e814866776 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051250 Jul 25 19:23:42.028066 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 555/1134] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:23:41 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:43.042632 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:43.044954 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:43.052083 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:43.052745 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:43.053563 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:43.053995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:43.088572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e7d7f3bd-94ce-4b5c-8ec3-625d8e45eeeb tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051165 Jul 25 19:23:43.089140 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 580/1135] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:23:43 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:44.101667 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:44.104002 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:44.111942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:44.112434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:44.115182 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:44.115182 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:44.144452 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-14bcc4b0-b43c-49ac-ab92-635b0797e61d tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046715 Jul 25 19:23:44.145420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 556/1136] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:23:44 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:23:44.214235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:44.214854 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:44.222835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:44.223291 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:44.224137 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:44.224637 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:44.253938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:23:44.632966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6385ba25-fd43-4066-a036-6c551172d28b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 204 len: 0 microversion: 2.1 time: 0.422500 Jul 25 19:23:44.633565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 581/1137] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:23:44 2022] DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:23:44.642208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:44.649840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:44.658728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:44.659243 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:44.660159 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:44.660761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:44.803015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:44.810740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-649afb42-e71d-4dfb-92e9-abcf0308ea0a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1682 microversion: 2.1 time: 0.172622 Jul 25 19:23:44.811388 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 557/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:44 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:45.832728 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:45.833414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:45.840658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:45.841128 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:45.841912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:45.842352 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:45.988245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:45.997222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1cb80f07-7ebb-4c22-a420-5aa96358d961 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1682 microversion: 2.1 time: 0.168649 Jul 25 19:23:45.997800 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 582/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:45 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:47.020937 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:47.021627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:47.028183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:47.028641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:47.029419 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:47.029946 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:47.204413 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:47.210501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1f4ee221-3583-4158-8cf4-8f06f69fcb93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1682 microversion: 2.1 time: 0.194307 Jul 25 19:23:47.211079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 558/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:47 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:23:47.543193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-5df8ccca-d883-45d7-8461-d5c5139184e6 req-f5a99fbc-078b-4152-88ca-e625972d7641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc78d785-eb78-41fa-a9a2-6c87430ec7b9", "name": "network-vif-deleted", "tag": "719a62f5-7567-4db5-af04-a4ceccec5b4e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:23:47.560726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-5df8ccca-d883-45d7-8461-d5c5139184e6 req-f5a99fbc-078b-4152-88ca-e625972d7641 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:47.562180 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-5df8ccca-d883-45d7-8461-d5c5139184e6 req-f5a99fbc-078b-4152-88ca-e625972d7641 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:47.573537 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-5df8ccca-d883-45d7-8461-d5c5139184e6 req-f5a99fbc-078b-4152-88ca-e625972d7641 service nova] Creating event network-vif-deleted:719a62f5-7567-4db5-af04-a4ceccec5b4e for instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 on hv-cinder-82002 Jul 25 19:23:47.579529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-5df8ccca-d883-45d7-8461-d5c5139184e6 req-f5a99fbc-078b-4152-88ca-e625972d7641 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039667 Jul 25 19:23:47.580179 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 583/1141] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:48.234772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:48.235529 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:48.245803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:48.246314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:48.247189 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:48.247632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:48.285862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:48.286349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:48.286811 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'fault' on Instance uuid fc78d785-eb78-41fa-a9a2-6c87430ec7b9 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:23:48.333666 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:48.344909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-78b8cba6-2f7f-4340-bf7d-9e4ec044426c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 200 len: 1330 microversion: 2.1 time: 0.115635 Jul 25 19:23:48.345492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 559/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:48 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:23:49.367757 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:49.368514 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:49.375655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:49.376102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:49.376876 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:49.377315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:49.393279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 HTTP/1.1 Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:23:49.395245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:23:49.397638 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'fc78d785-eb78-41fa-a9a2-6c87430ec7b9'} Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:23:49.399072 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:23:49.401195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:23:49.403406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:23:49.403406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4decab49-9421-4353-b43d-284aacd7dddf tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 404 len: 111 microversion: 2.1 time: 0.033262 Jul 25 19:23:49.403406 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 584/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:49 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:23:49.406859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f333be96-feb2-4a74-acfd-e48709e0c4d5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '.version_select at 0x7fd8e5811af0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:49.617402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f333be96-feb2-4a74-acfd-e48709e0c4d5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454593952" status: 202 len: 0 microversion: 2.1 time: 0.214890 Jul 25 19:23:49.618005 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 560/1144] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Jul 25 19:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454593952 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:23:50.526555 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0988d9b6-cd70-42e9-8836-6cc46b2341ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: .version_select at 0x7fd8e5cc6d30>, body: {"keypair": {"name": "tempest-keypair-135109074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkPB11iLfg+40uqO81iPlelI/OoP0QhZExnJMepwh/yKTMHinCuAvEmONUk1m3CFJ1U52om93Za5ytO0aLxxnAE6WwsXSc879FOYD09oRCD/b+sbnAeebDWis0FQ/PW5Q=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:23:50.542967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-0988d9b6-cd70-42e9-8836-6cc46b2341ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:23:50.547843 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-0988d9b6-cd70-42e9-8836-6cc46b2341ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:23:50.651766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0988d9b6-cd70-42e9-8836-6cc46b2341ef tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128959 Jul 25 19:23:50.652232 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 585/1145] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:23:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:23:53.217128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1569756552", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6364bb15-7d49-4471-b756-05562b7f4867"}], "security_groups": [{"name": "tempest-securitygroup--789014552"}], "key_name": "tempest-keypair-135109074", "user_data": "}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:23:53.336514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] validate_networks() for [('6364bb15-7d49-4471-b756-05562b7f4867', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:23:53.997674 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:23:53.998092 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:23:53.999402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:23:53.999874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:23:54.000281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:23:54.009495 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:54.009938 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:54.010781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:54.011209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:54.031289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:23:54.035900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:23:54.048178 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:23:54.050524 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:23:54.188743 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:23:55.196587 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38494. Jul 25 19:23:55.200990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ff5a08f3-b2cb-41b4-a04e-5e32128b780a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.989204 Jul 25 19:23:55.202015 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 561/1146] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:23:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:23:55.214019 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e0ea34d9-16f6-4827-bc6c-9caa53f3f7fc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:55.215323 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e0ea34d9-16f6-4827-bc6c-9caa53f3f7fc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:55.275475 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e0ea34d9-16f6-4827-bc6c-9caa53f3f7fc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:55.284256 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e0ea34d9-16f6-4827-bc6c-9caa53f3f7fc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1241 microversion: 2.1 time: 0.073987 Jul 25 19:23:55.285378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 586/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:55 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:56.311801 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-34b0563b-4264-4242-9507-274068d0dca5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:56.313465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-34b0563b-4264-4242-9507-274068d0dca5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:56.382710 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-34b0563b-4264-4242-9507-274068d0dca5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:56.389577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-34b0563b-4264-4242-9507-274068d0dca5 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1241 microversion: 2.1 time: 0.084155 Jul 25 19:23:56.390211 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 562/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:56 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:57.411027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8993864b-726e-4655-bfd1-07bed0845f7b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:57.412266 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8993864b-726e-4655-bfd1-07bed0845f7b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:57.471463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8993864b-726e-4655-bfd1-07bed0845f7b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:57.480081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8993864b-726e-4655-bfd1-07bed0845f7b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1241 microversion: 2.1 time: 0.072444 Jul 25 19:23:57.480081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 587/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:57 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:58.504103 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c7b67040-531c-400f-81be-24414289b3e4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:58.504966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c7b67040-531c-400f-81be-24414289b3e4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:58.562721 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c7b67040-531c-400f-81be-24414289b3e4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:58.569712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c7b67040-531c-400f-81be-24414289b3e4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1241 microversion: 2.1 time: 0.070177 Jul 25 19:23:58.570294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 563/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:58 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:23:59.590641 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:23:59.591404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:23:59.594430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:59.602216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:59.602861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:59.603442 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:23:59.604111 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:23:59.667082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:23:59.676064 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-4f5b841a-38e0-41b3-b069-8f0281f0964b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1245 microversion: 2.1 time: 0.089764 Jul 25 19:23:59.676628 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 588/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:23:59 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:00.697423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:00.698064 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:00.705815 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:00.706306 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:00.707195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:00.707663 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:00.776226 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:00.787926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-007dad5a-27e9-45b9-9c19-3e1d3065cc6e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1237 microversion: 2.1 time: 0.094448 Jul 25 19:24:00.788517 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 564/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:00 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:01.816985 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:01.817727 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:01.825281 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:01.825827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:01.826661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:01.827098 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:01.918282 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:01.926712 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f7318600-0327-4375-8957-bda68aab0618 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1299 microversion: 2.1 time: 0.114508 Jul 25 19:24:01.927303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 589/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:01 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:02.949116 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:02.950444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:02.957954 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:02.958444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:02.959244 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:02.959660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:03.106892 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:03.116840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b8c7160d-d2e5-421d-b454-728b7d6c8c64 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.171303 Jul 25 19:24:03.117441 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 565/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:02 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:03.401655 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-3d178d0b-0b05-4c7c-afcb-9608e5b29be0 req-ed98d476-4aac-45ac-b4e1-34f8ee8b0d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4db95d-75b6-4cdb-a23f-32014303d87f", "tag": "11dc86c9-ed3d-4091-8b53-5a71173adee4"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:03.406048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-3d178d0b-0b05-4c7c-afcb-9608e5b29be0 req-ed98d476-4aac-45ac-b4e1-34f8ee8b0d40 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:03.406533 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-3d178d0b-0b05-4c7c-afcb-9608e5b29be0 req-ed98d476-4aac-45ac-b4e1-34f8ee8b0d40 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:03.420493 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-3d178d0b-0b05-4c7c-afcb-9608e5b29be0 req-ed98d476-4aac-45ac-b4e1-34f8ee8b0d40 service nova] Creating event network-changed:11dc86c9-ed3d-4091-8b53-5a71173adee4 for instance ca4db95d-75b6-4cdb-a23f-32014303d87f on hv-cinder-82002 Jul 25 19:24:03.427391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-3d178d0b-0b05-4c7c-afcb-9608e5b29be0 req-ed98d476-4aac-45ac-b4e1-34f8ee8b0d40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036091 Jul 25 19:24:03.428116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 590/1155] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:24:04.139143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:04.140768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:04.144252 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:04.148085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:04.148523 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:04.149296 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:04.149729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:04.300812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:04.308715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0cd0a00f-86a6-47b5-af59-6b0c2cd66c47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.173643 Jul 25 19:24:04.309303 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 566/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:04 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:05.332609 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:05.333310 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:05.340239 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:05.340677 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:05.341454 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:05.341908 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:05.493982 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:05.502048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a3033e3a-8dc4-4bcf-af1c-de34cb69de28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.174942 Jul 25 19:24:05.502682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 591/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:05 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:24:06.523272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:06.524029 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:06.529292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:06.535170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:06.535542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:06.536310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:06.536750 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:06.539529 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=79 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:06.680647 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:06.689431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c5192455-fde6-4d41-bccc-cdad1ddf6a27 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.170018 Jul 25 19:24:06.690021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 567/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:06 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:07.712323 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:07.712956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:07.715153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=8 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:07.715934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:07.722682 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:07.723124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:07.723904 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:07.724337 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:07.884940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:07.895533 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-fa7be57b-7814-434e-922a-67a9460f80e7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.186499 Jul 25 19:24:07.896309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 592/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:07 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:24:08.924391 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=10 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:09.016365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:09.017280 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:09.026582 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:09.027175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:09.028331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:09.028879 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:09.206030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:09.213983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fc1568b8-a236-42c1-8cec-c6beb346018c tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.299792 Jul 25 19:24:09.214622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 568/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:08 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:10.239734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:10.240389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:10.248031 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:10.248485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:10.249816 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:10.250259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:10.398257 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:10.406946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3209002b-7785-47f6-aab4-6deefa8240ec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.175185 Jul 25 19:24:10.407538 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 593/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:10 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:11.069874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4db95d-75b6-4cdb-a23f-32014303d87f", "name": "network-vif-plugged", "status": "completed", "tag": "11dc86c9-ed3d-4091-8b53-5a71173adee4"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:11.081344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:11.081781 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:11.094057 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] Creating event network-vif-plugged:11dc86c9-ed3d-4091-8b53-5a71173adee4 for instance ca4db95d-75b6-4cdb-a23f-32014303d87f on hv-cinder-82002 Jul 25 19:24:11.097783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] [63c18702-8ccb-439c-b778-a59cd68adc57] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:24:11.428379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:11.428923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:11.435806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:11.436250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:11.437050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:11.437472 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:11.584509 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:11.594250 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-28407ecd-97d2-427d-8670-3f2f59e65c0b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.169991 Jul 25 19:24:11.594986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 594/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:11 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:12.105863 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] [63c18702-8ccb-439c-b778-a59cd68adc57] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38552. Jul 25 19:24:12.111521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-94de27b0-175f-4d55-bfbb-a8cb2a608f0b req-2ac65513-034c-412f-a555-7949f7611cab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.045765 Jul 25 19:24:12.119146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 569/1163] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:12.618891 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:12.619734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:12.629253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:12.629253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:12.629253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:12.629253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:12.803522 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:12.809023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1d842242-c05c-4aff-98da-da62575680cc tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.196326 Jul 25 19:24:12.809611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 595/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:12 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:13.832772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:13.833556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:13.840079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:13.840520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:13.841294 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:13.841726 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:13.996874 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:14.005192 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0d02cf06-232c-4d52-bbfc-e245d48a67ed tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1366 microversion: 2.1 time: 0.177219 Jul 25 19:24:14.005783 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 570/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:13 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:15.032621 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:15.033403 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:15.043125 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:15.043760 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:15.044912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:15.045525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:15.203611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:24:15.212136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bb82b285-0334-4363-9ac8-d112f7949594 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1557 microversion: 2.1 time: 0.183818 Jul 25 19:24:15.212881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 596/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:24:15 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1557 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:24:15.237593 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:24:15.238292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:24:15.249580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:15.250411 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:15.251458 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:15.251906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:15.341535 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6d210d0d-2529-4465-bec4-16dd43136bec tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110357 Jul 25 19:24:15.342171 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 571/1167] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:24:15 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:16.566192 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-7f1c14ef-5f12-48cd-89ee-a4a5e023dc8b req-cd9c93af-61cc-4466-96b8-42893d1b36c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4db95d-75b6-4cdb-a23f-32014303d87f", "tag": "11dc86c9-ed3d-4091-8b53-5a71173adee4"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:24:16.576569 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-7f1c14ef-5f12-48cd-89ee-a4a5e023dc8b req-cd9c93af-61cc-4466-96b8-42893d1b36c5 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:24:16.577130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-7f1c14ef-5f12-48cd-89ee-a4a5e023dc8b req-cd9c93af-61cc-4466-96b8-42893d1b36c5 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:24:16.589135 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-7f1c14ef-5f12-48cd-89ee-a4a5e023dc8b req-cd9c93af-61cc-4466-96b8-42893d1b36c5 service nova] Creating event network-changed:11dc86c9-ed3d-4091-8b53-5a71173adee4 for instance ca4db95d-75b6-4cdb-a23f-32014303d87f on hv-cinder-82002 Jul 25 19:24:16.595089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-7f1c14ef-5f12-48cd-89ee-a4a5e023dc8b req-cd9c93af-61cc-4466-96b8-42893d1b36c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116279 Jul 25 19:24:16.595946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 597/1168] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:24:36.098835 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:24:36.099706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:25:43.202491 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=9 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:43.203722 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=23 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:43.210046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:43.210944 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:43.220141 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.260646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.260646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:43.260646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:43.260646 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-352d46d0-866f-4aa0-8944-b7c2af57a03f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/ips" status: 200 len: 151 microversion: 2.1 time: 0.046933 Jul 25 19:25:43.261108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 572/1169] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:25:43 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:46.063830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=11 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:46.064498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=52 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:46.070780 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f5927dd-7304-4421-8789-5e3a017c9a8d"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:46.075558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:46.080583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.081032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.081962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:46.082302 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:46.905136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5b49619f-40b6-4166-9a7f-df4150e1f7fe tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844282 Jul 25 19:25:46.905856 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 598/1170] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:25:46 2022] POST /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:54.484805 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f5927dd-7304-4421-8789-5e3a017c9a8d"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:54.487405 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:54.495375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.495839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.496603 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.497043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.592592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Invalid volume: volume 9f5927dd-7304-4421-8789-5e3a017c9a8d is already attached to instances: ca4db95d-75b6-4cdb-a23f-32014303d87f Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: POST /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments HTTP/1.1 Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 74 Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:25:54.594358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {"volumeAttachment": {"volumeId": "9f5927dd-7304-4421-8789-5e3a017c9a8d"}} Jul 25 19:25:54.596102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Invalid volume: volume 9f5927dd-7304-4421-8789-5e3a017c9a8d is already attached to instances: ca4db95d-75b6-4cdb-a23f-32014303d87f Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'server_id': 'ca4db95d-75b6-4cdb-a23f-32014303d87f', 'body': {'volumeAttachment': {'volumeId': '9f5927dd-7304-4421-8789-5e3a017c9a8d'}}} Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9f5927dd-7304-4421-8789-5e3a017c9a8d is already attached to instances: ca4db95d-75b6-4cdb-a23f-32014303d87f Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:25:54.597074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9f5927dd-7304-4421-8789-5e3a017c9a8d is already attached to instances: ca4db95d-75b6-4cdb-a23f-32014303d87f Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:25:54.598670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9f5927dd-7304-4421-8789-5e3a017c9a8d is already attached to instances: ca4db95d-75b6-4cdb-a23f-32014303d87f Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 400 to user: Invalid volume: volume 9f5927dd-7304-4421-8789-5e3a017c9a8d is already attached to instances: ca4db95d-75b6-4cdb-a23f-32014303d87f {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1afa54c1-ac6a-4292-bcc3-c56809f2bf2e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115680 Jul 25 19:25:54.600429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 573/1171] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:25:54 2022] POST /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 19:25:54.666924 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:54.667512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:54.674871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.675527 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.676305 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:54.676741 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:54.764683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'services' on Instance uuid ca4db95d-75b6-4cdb-a23f-32014303d87f {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:25:54.994153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7df87358-98b3-4142-9578-ad4802514a28 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments/9f5927dd-7304-4421-8789-5e3a017c9a8d" status: 202 len: 0 microversion: 2.1 time: 0.331844 Jul 25 19:25:54.994781 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 599/1172] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:25:54 2022] DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments/9f5927dd-7304-4421-8789-5e3a017c9a8d => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:25:55.004345 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:55.006630 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:55.012981 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:55.013427 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.015114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:55.015571 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:55.050138 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9d227ea6-6488-4edd-80a1-b8d0dac43393 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049976 Jul 25 19:25:55.050754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 574/1173] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:25:54 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:25:56.063874 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:56.066133 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:56.072838 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.073290 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.074059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.074551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.106928 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ad7f83cf-138c-4d51-aebb-1103e95247c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048516 Jul 25 19:25:56.108017 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 600/1174] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:25:56 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:25:56.179906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:56.180429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:56.188050 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.188501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.189283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.189721 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.217728 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:25:56.572752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c996bac0-2394-466f-ab23-91a8fd5d59e9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 204 len: 0 microversion: 2.1 time: 0.396059 Jul 25 19:25:56.603617 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 575/1175] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:25:56 2022] DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:25:56.603784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:56.603784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:56.603784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.603784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.604199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:56.604199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:56.767441 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:56.775739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3f806333-a88c-48fe-a559-8870d8fe4a47 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1682 microversion: 2.1 time: 0.196735 Jul 25 19:25:56.776525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 601/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:56 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:57.799936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:57.800660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:57.808367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:57.808803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:57.809580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:57.810004 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:57.965930 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:57.976941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-043df9e0-48ab-468d-90da-09bbfa57650f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1682 microversion: 2.1 time: 0.181796 Jul 25 19:25:57.977564 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 576/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:57 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:59.005963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:25:59.006526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:25:59.013384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.013844 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.014661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.015770 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.144359 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:25:59.144359 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b42a8589-16c8-4ac0-aa1a-d2d2ff63b0bd tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1615 microversion: 2.1 time: 0.106445 Jul 25 19:25:59.144359 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 602/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:25:59 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1615 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:25:59.387086 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-1cd507e1-804e-4023-bf00-4de92c6866d0 req-ae1af977-13d6-4646-98d9-d5e0ec63f6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4db95d-75b6-4cdb-a23f-32014303d87f", "name": "network-vif-deleted", "tag": "11dc86c9-ed3d-4091-8b53-5a71173adee4"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:25:59.401996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-1cd507e1-804e-4023-bf00-4de92c6866d0 req-ae1af977-13d6-4646-98d9-d5e0ec63f6f4 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:25:59.401996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-1cd507e1-804e-4023-bf00-4de92c6866d0 req-ae1af977-13d6-4646-98d9-d5e0ec63f6f4 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:25:59.412468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-1cd507e1-804e-4023-bf00-4de92c6866d0 req-ae1af977-13d6-4646-98d9-d5e0ec63f6f4 service nova] Creating event network-vif-deleted:11dc86c9-ed3d-4091-8b53-5a71173adee4 for instance ca4db95d-75b6-4cdb-a23f-32014303d87f on hv-cinder-82002 Jul 25 19:25:59.418534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-1cd507e1-804e-4023-bf00-4de92c6866d0 req-ae1af977-13d6-4646-98d9-d5e0ec63f6f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 Jul 25 19:25:59.419158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 577/1179] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:00.138378 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:00.139087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:00.147804 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.148293 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.149127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.149587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.185734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:00.186218 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:00.187567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'fault' on Instance uuid ca4db95d-75b6-4cdb-a23f-32014303d87f {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:26:00.237645 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:00.245578 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1fe33519-49da-4070-9927-7bf303924828 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 200 len: 1331 microversion: 2.1 time: 0.111266 Jul 25 19:26:00.246154 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 603/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:00 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:01.271151 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:01.271858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:01.278414 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:01.278860 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:01.279666 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:01.280100 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:01.295599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f HTTP/1.1 Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:26:01.297934 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:26:01.299691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'ca4db95d-75b6-4cdb-a23f-32014303d87f'} Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:26:01.300802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:26:01.302154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:26:01.303842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:26:01.303842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-88e9dbf0-7fec-424a-a33c-af822eb0cb98 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 404 len: 111 microversion: 2.1 time: 0.032978 Jul 25 19:26:01.303842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 578/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:01 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:26:01.308593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-575b5b1e-736b-451b-8235-b2a1b93a1994 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '.version_select at 0x7fd8e7a159d0>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:01.413324 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-575b5b1e-736b-451b-8235-b2a1b93a1994 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135109074" status: 202 len: 0 microversion: 2.1 time: 0.108519 Jul 25 19:26:01.413829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 604/1182] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Jul 25 19:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135109074 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:26:02.291069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-679d7092-0f4f-42c5-b8f3-e01ea49fbf35 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: .version_select at 0x7fd8ea444b80>, body: {"keypair": {"name": "tempest-keypair-1006649010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOExXr/DvZn6IvlY80zO+HzBHmC6sqrNhKv8IanajJ66hsrnDrjBRyA6iDiTge1fLEupXTE1fhqVAfmUwNbE/ElXNIwxvYG3owIV8TEkagPcLV/PxuXG6bWwlOb3tP1UA=="}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:02.307102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-679d7092-0f4f-42c5-b8f3-e01ea49fbf35 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:26:02.311068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-679d7092-0f4f-42c5-b8f3-e01ea49fbf35 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:26:02.387127 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-679d7092-0f4f-42c5-b8f3-e01ea49fbf35 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099828 Jul 25 19:26:02.387730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 579/1183] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:26:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:05.048457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-749358101", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6364bb15-7d49-4471-b756-05562b7f4867"}], "security_groups": [{"name": "tempest-securitygroup--1822393925"}], "key_name": "tempest-keypair-1006649010", "user_data": "}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:05.163013 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] validate_networks() for [('6364bb15-7d49-4471-b756-05562b7f4867', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:26:05.572004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:26:05.572421 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:26:05.572944 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:26:05.573349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:26:05.573750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:26:05.583788 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:05.584231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.585026 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:05.585453 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:05.603589 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:26:05.607540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Getting quotas for user 61d6214556954b778dc86a0d376a8d6e and project c283d74bc1404c078fa9c350c8acfe4a. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:26:05.619886 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:26:05.621489 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:26:05.761710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8f81a2c3-9014-4a3f-9667-0f9b396445d7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718951 Jul 25 19:26:05.762393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 605/1184] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:26:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:26:05.774378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8bf0f0cf-1202-4491-b988-ab16d6937372 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:05.775207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8bf0f0cf-1202-4491-b988-ab16d6937372 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:05.844486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8bf0f0cf-1202-4491-b988-ab16d6937372 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:05.858940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8bf0f0cf-1202-4491-b988-ab16d6937372 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1241 microversion: 2.1 time: 0.088560 Jul 25 19:26:05.860397 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 580/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:05 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:06.884342 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:06.884999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:06.892284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.892761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:06.893537 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:06.893971 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:06.960076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:06.967825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-90418c09-eee7-4db0-9c32-4d367cc59354 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1245 microversion: 2.1 time: 0.088027 Jul 25 19:26:06.968400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 606/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:06 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:07.993542 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:07.994803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:08.004931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:08.005680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.006978 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:08.007604 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:08.083525 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:08.091536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8690bded-2155-4001-b9a4-2424acaa8340 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1301 microversion: 2.1 time: 0.104353 Jul 25 19:26:08.092153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 581/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:07 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:09.115933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:09.115933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:09.122934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.123380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.124164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.124594 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.357267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:09.370576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-43fdd5e8-95ad-4860-bcf3-b97582203d72 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.260370 Jul 25 19:26:09.371044 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 607/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:09 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:09.958596 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-bc6d7e38-bc91-46ee-be77-53a4bc2d76e8 req-7e99f94a-5090-43d2-9709-86fd04331bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c860d1b-67f0-420c-9a56-bd92056efe11", "tag": "4f3aead6-5014-4e1b-b5e8-86fa7130a45f"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:09.977161 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-bc6d7e38-bc91-46ee-be77-53a4bc2d76e8 req-7e99f94a-5090-43d2-9709-86fd04331bed service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:09.977866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-bc6d7e38-bc91-46ee-be77-53a4bc2d76e8 req-7e99f94a-5090-43d2-9709-86fd04331bed service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:09.998968 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-bc6d7e38-bc91-46ee-be77-53a4bc2d76e8 req-7e99f94a-5090-43d2-9709-86fd04331bed service nova] Creating event network-changed:4f3aead6-5014-4e1b-b5e8-86fa7130a45f for instance 0c860d1b-67f0-420c-9a56-bd92056efe11 on hv-cinder-82002 Jul 25 19:26:10.006316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-bc6d7e38-bc91-46ee-be77-53a4bc2d76e8 req-7e99f94a-5090-43d2-9709-86fd04331bed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053436 Jul 25 19:26:10.011624 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 582/1189] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:10.393028 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:10.393639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:10.403054 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:10.403458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:10.404254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:10.404707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:10.629947 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:10.637548 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-368e28cd-600f-4104-b949-6ad4507db16f tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.249146 Jul 25 19:26:10.638126 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 608/1190] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:10 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:11.662209 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:11.662950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:11.669333 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:11.669772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:11.670563 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:11.670990 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:11.807837 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:11.816284 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7b622ada-6998-4ec1-a922-d6b8fc1e828a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.159990 Jul 25 19:26:11.816869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 583/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:11 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:12.837420 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:12.839075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:12.845109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:12.845552 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:12.846355 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:12.846795 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:12.990750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:12.998735 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bfc3147f-eb76-4c36-a314-0ed66c102f13 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.165390 Jul 25 19:26:12.999306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 609/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:12 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:14.020761 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:14.021398 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:14.028220 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:14.028675 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:14.029454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:14.029900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:14.171825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:14.180918 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ee1674f4-074d-4d0f-ad11-c4214dd2bee8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.164732 Jul 25 19:26:14.181498 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 584/1193] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:14 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:15.204020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:15.204766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:15.211373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.211810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.212582 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:15.213017 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:15.351041 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:15.359118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c7790a47-11ef-47b8-bf85-35546f2536a4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.160039 Jul 25 19:26:15.360225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 610/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:15 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:16.382143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:16.382746 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:16.385185 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:16.390290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:16.390766 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:16.392128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:16.392559 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:16.540416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:16.549000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bc51a429-140e-4ab2-b43d-803ba8c1543e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.170923 Jul 25 19:26:16.549567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 585/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:16 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:17.571464 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:17.572236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:17.574391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:17.575089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:17.576249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:17.582572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.584598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.584598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.584598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.588857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:17.664501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-8660de8b-7225-4deb-95af-3945147e1482 req-9ef582b5-5fa7-4690-b74d-af8442417fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c860d1b-67f0-420c-9a56-bd92056efe11", "name": "network-vif-plugged", "status": "completed", "tag": "4f3aead6-5014-4e1b-b5e8-86fa7130a45f"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:17.678023 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-8660de8b-7225-4deb-95af-3945147e1482 req-9ef582b5-5fa7-4690-b74d-af8442417fff service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:17.678463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-8660de8b-7225-4deb-95af-3945147e1482 req-9ef582b5-5fa7-4690-b74d-af8442417fff service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:17.692346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-8660de8b-7225-4deb-95af-3945147e1482 req-9ef582b5-5fa7-4690-b74d-af8442417fff service nova] Creating event network-vif-plugged:4f3aead6-5014-4e1b-b5e8-86fa7130a45f for instance 0c860d1b-67f0-420c-9a56-bd92056efe11 on hv-cinder-82002 Jul 25 19:26:17.698698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-8660de8b-7225-4deb-95af-3945147e1482 req-9ef582b5-5fa7-4690-b74d-af8442417fff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039699 Jul 25 19:26:17.699695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 586/1196] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:17.796431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:17.804858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7e464a3a-3ad0-4922-92d7-168e2b962db7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.237333 Jul 25 19:26:17.808299 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 611/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:17 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:26:18.826784 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:18.827506 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:18.835078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:18.835522 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:18.836292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:18.836721 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:18.987889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:18.999555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-5c1a83b6-81af-4bd9-9182-b64606acbfc9 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1367 microversion: 2.1 time: 0.177144 Jul 25 19:26:19.001187 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 587/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:18 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:20.026776 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:20.027550 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:20.037038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.037490 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.042284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.042284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.217381 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:26:20.225344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5920ff0c-6a90-4df9-985e-a28a0280ded3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1557 microversion: 2.1 time: 0.203163 Jul 25 19:26:20.225925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 612/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:26:20 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1557 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:26:20.246479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:26:20.247072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:26:20.255305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.255784 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.256574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:20.257016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:20.345609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0db76951-171e-4ad4-839f-65bfbd98b35e tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097459 Jul 25 19:26:20.345609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 588/1200] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Jul 25 19:26:20 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:26:21.738973 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-274348fc-fadd-47e4-8156-31dd40e26e56 req-50e3af0a-3b8a-4a46-ac84-a1dfae36886f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c860d1b-67f0-420c-9a56-bd92056efe11", "tag": "4f3aead6-5014-4e1b-b5e8-86fa7130a45f"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:26:21.752077 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-274348fc-fadd-47e4-8156-31dd40e26e56 req-50e3af0a-3b8a-4a46-ac84-a1dfae36886f service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:26:21.752590 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-274348fc-fadd-47e4-8156-31dd40e26e56 req-50e3af0a-3b8a-4a46-ac84-a1dfae36886f service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:26:21.764322 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-274348fc-fadd-47e4-8156-31dd40e26e56 req-50e3af0a-3b8a-4a46-ac84-a1dfae36886f service nova] Creating event network-changed:4f3aead6-5014-4e1b-b5e8-86fa7130a45f for instance 0c860d1b-67f0-420c-9a56-bd92056efe11 on hv-cinder-82002 Jul 25 19:26:21.771136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-274348fc-fadd-47e4-8156-31dd40e26e56 req-50e3af0a-3b8a-4a46-ac84-a1dfae36886f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036268 Jul 25 19:26:21.772387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 613/1201] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:49.505049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:49.505862 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:49.510247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:27:49.510768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:49.520891 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.521336 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.522123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:49.522597 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:49.554131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-47ca4b64-09b2-4d50-987b-2662ca67573a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/ips" status: 200 len: 150 microversion: 2.1 time: 0.051052 Jul 25 19:27:49.554959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 589/1202] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Jul 25 19:27:49 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:27:52.304187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=5 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:52.304936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=13 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:52.310498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e26e7d0-386c-477f-94b9-acd0a8dca4c5"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:27:52.313907 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:27:52.319830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.320400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:52.321188 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:27:52.321631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:27:53.092912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-eaf4ad58-5972-4c4d-a0fa-07672667b6c2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "POST /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790463 Jul 25 19:27:53.093717 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 614/1203] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:27:52 2022] POST /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:00.772807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:00.773549 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:00.781411 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:00.781856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:00.782668 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:00.783097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:00.983378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'services' on Instance uuid 0c860d1b-67f0-420c-9a56-bd92056efe11 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:28:01.175355 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0ac07735-c27c-4d45-972b-33c33285a741 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments/1e26e7d0-386c-477f-94b9-acd0a8dca4c5" status: 202 len: 0 microversion: 2.1 time: 0.406900 Jul 25 19:28:01.175966 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 590/1204] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:28:00 2022] DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments/1e26e7d0-386c-477f-94b9-acd0a8dca4c5 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:28:01.187226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:01.189562 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:01.196620 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:01.197066 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:01.197832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:01.198999 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:01.235227 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-116ee7a9-9d79-4f83-ac7d-dd5176d72ea7 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054502 Jul 25 19:28:01.235827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 615/1205] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:28:01 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:02.250666 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:02.253088 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:02.259839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.260360 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.261931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.262426 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.294589 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-813cb9b4-405a-4f54-b21a-10112cc010a2 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050354 Jul 25 19:28:02.295174 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 591/1206] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:28:02 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:28:02.367628 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:02.368210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:02.375716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.378510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.378510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.378510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.417787 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:28:02.694214 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ed8b2791-87ec-466b-a129-04280ae9205a tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 204 len: 0 microversion: 2.1 time: 0.330731 Jul 25 19:28:02.694878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 616/1207] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:28:02 2022] DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:28:02.704281 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:02.705043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:02.711591 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.712073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.712693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:02.713124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:02.865534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:02.874168 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1addee8b-5c02-4df8-98e7-e2785743f2c3 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1682 microversion: 2.1 time: 0.174211 Jul 25 19:28:02.878317 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 592/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:02 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:03.898076 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:03.898807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:03.906880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:03.907322 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:03.908102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:03.908534 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:04.074387 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:04.082729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0b204604-12d8-4865-8bc2-34654ea445c0 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1682 microversion: 2.1 time: 0.188927 Jul 25 19:28:04.083285 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 617/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:03 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:05.106977 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:05.107544 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:05.114293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:05.114772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:05.115655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:05.116202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:05.271948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:05.280670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-2f63290f-42a0-46d2-8ab3-67e263a9e598 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1682 microversion: 2.1 time: 0.178079 Jul 25 19:28:05.281262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 593/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:05 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:05.813580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-41a965bd-c70a-4074-a9ff-8ed1059d6903 req-75ffb942-f233-4060-b4ea-aae5c1b28023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c860d1b-67f0-420c-9a56-bd92056efe11", "name": "network-vif-deleted", "tag": "4f3aead6-5014-4e1b-b5e8-86fa7130a45f"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:28:05.829631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-41a965bd-c70a-4074-a9ff-8ed1059d6903 req-75ffb942-f233-4060-b4ea-aae5c1b28023 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:05.830198 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-41a965bd-c70a-4074-a9ff-8ed1059d6903 req-75ffb942-f233-4060-b4ea-aae5c1b28023 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:05.853176 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-41a965bd-c70a-4074-a9ff-8ed1059d6903 req-75ffb942-f233-4060-b4ea-aae5c1b28023 service nova] Creating event network-vif-deleted:4f3aead6-5014-4e1b-b5e8-86fa7130a45f for instance 0c860d1b-67f0-420c-9a56-bd92056efe11 on hv-cinder-82002 Jul 25 19:28:05.859827 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-41a965bd-c70a-4074-a9ff-8ed1059d6903 req-75ffb942-f233-4060-b4ea-aae5c1b28023 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124075 Jul 25 19:28:05.860970 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 618/1211] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:28:06.304390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:06.305032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:06.312665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.313867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.313983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.314350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.352410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:06.352852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:06.353843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lazy-loading 'fault' on Instance uuid 0c860d1b-67f0-420c-9a56-bd92056efe11 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:28:06.398583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d6214556954b778dc86a0d376a8d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c283d74bc1404c078fa9c350c8acfe4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:28:06.412475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b92099b5-0c57-4f88-b567-a5ef49dcffc6 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 200 len: 1331 microversion: 2.1 time: 0.109972 Jul 25 19:28:06.412475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 594/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:06 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:28:07.435938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:07.436679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:07.443265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:07.443710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:07.444488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:07.444923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:07.460396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 HTTP/1.1 Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:28:07.462226 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:07.464120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '0c860d1b-67f0-420c-9a56-bd92056efe11'} Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:07.465112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:07.466568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:07.467834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:07.467834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-d06bb805-28d1-4c6a-94a1-e74bba36c1e8 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 404 len: 111 microversion: 2.1 time: 0.033200 Jul 25 19:28:07.467834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 619/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:07 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:07.474390 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-eac713d7-fd75-4b27-918a-f9df51353783 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '.version_select at 0x7fd8ea5061f0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:07.553819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-eac713d7-fd75-4b27-918a-f9df51353783 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006649010" status: 202 len: 0 microversion: 2.1 time: 0.082931 Jul 25 19:28:07.554857 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 595/1214] 10.222.0.17 () {58 vars in 1221 bytes} [Mon Jul 25 19:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006649010 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 19:28:09.722275 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:09.722826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:09.729434 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.731187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.732549 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.733061 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.756771 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 HTTP/1.1 Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:28:09.760005 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.761832 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '0c860d1b-67f0-420c-9a56-bd92056efe11'} Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:09.762820 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.764418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.766191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:09.766191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-74440123-d9d4-48b2-93f5-e0da9a7e4784 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 404 len: 111 microversion: 2.1 time: 0.043825 Jul 25 19:28:09.766191 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 620/1215] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:28:09 2022] DELETE /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:09.773479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:09.774098 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 0c860d1b-67f0-420c-9a56-bd92056efe11] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:09.782316 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.782797 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.783574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:09.784016 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:09.798951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 HTTP/1.1 Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:28:09.800643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.805878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '0c860d1b-67f0-420c-9a56-bd92056efe11'} Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:09.806889 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. Jul 25 19:28:09.809231 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:09.811081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance 0c860d1b-67f0-420c-9a56-bd92056efe11 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:09.811081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bc690a29-13f6-405c-a375-848b5dfae082 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11" status: 404 len: 111 microversion: 2.1 time: 0.033093 Jul 25 19:28:09.811081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 596/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:09 2022] GET /compute/v2.1/servers/0c860d1b-67f0-420c-9a56-bd92056efe11 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:11.120484 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:11.121306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:11.127745 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.128266 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.129058 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.129498 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.152615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f HTTP/1.1 Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:28:11.154399 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.156156 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'ca4db95d-75b6-4cdb-a23f-32014303d87f'} Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:11.157004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.158631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.160060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:11.160060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dc444fbd-03bc-4a44-862f-e27da3f69613 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 404 len: 111 microversion: 2.1 time: 0.039950 Jul 25 19:28:11.160060 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 621/1217] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:28:11 2022] DELETE /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:11.164696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:11.165314 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: ca4db95d-75b6-4cdb-a23f-32014303d87f] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:11.175263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.175633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.176552 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.176900 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.191954 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f HTTP/1.1 Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:28:11.193520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.196033 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'ca4db95d-75b6-4cdb-a23f-32014303d87f'} Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:11.197136 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. Jul 25 19:28:11.199329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.200947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance ca4db95d-75b6-4cdb-a23f-32014303d87f could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:11.200947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f26a0237-b383-4c03-9bc2-7180d3829a93 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f" status: 404 len: 111 microversion: 2.1 time: 0.034223 Jul 25 19:28:11.200947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 597/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:11 2022] GET /compute/v2.1/servers/ca4db95d-75b6-4cdb-a23f-32014303d87f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:11.207141 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:11.208583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:11.214300 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.214830 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.215618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.216058 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.231888 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd HTTP/1.1 Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:28:11.233469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.235142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '15608567-7691-4662-ae63-1f4c209689dd'} Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:11.236130 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.237412 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.238756 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:11.238756 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8990715a-c99a-4cd5-8478-89af7b17f18b tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 404 len: 111 microversion: 2.1 time: 0.031726 Jul 25 19:28:11.238756 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 622/1219] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:28:11 2022] DELETE /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:11.243870 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:11.246106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: 15608567-7691-4662-ae63-1f4c209689dd] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:11.251823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.252274 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.253049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:11.253503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:11.268768 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd HTTP/1.1 Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:28:11.270349 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.271987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '15608567-7691-4662-ae63-1f4c209689dd'} Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:11.272933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. Jul 25 19:28:11.274460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:11.275957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance 15608567-7691-4662-ae63-1f4c209689dd could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:11.275957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-57880fa9-45f3-49a9-ba21-f095e43df4c4 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd" status: 404 len: 111 microversion: 2.1 time: 0.031893 Jul 25 19:28:11.275957 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 598/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:11 2022] GET /compute/v2.1/servers/15608567-7691-4662-ae63-1f4c209689dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:28:12.553382 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:12.553977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:12.561222 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:12.569691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:12.569691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:12.569691 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:12.577751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 HTTP/1.1 Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:28:12.579278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.580966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'fc78d785-eb78-41fa-a9a2-6c87430ec7b9'} Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:12.581793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.583163 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.584429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:12.584429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2d20ce0c-c563-4d54-a673-fc5d578c7638 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 404 len: 111 microversion: 2.1 time: 0.031283 Jul 25 19:28:12.584429 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 623/1221] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:28:12 2022] DELETE /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:28:12.591102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:28:12.591813 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] [instance: fc78d785-eb78-41fa-a9a2-6c87430ec7b9] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:28:12.601541 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:12.602416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:12.607076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:28:12.607076 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:28:12.634400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] HTTP exception thrown: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Request method failure captured: Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 HTTP/1.1 Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3uystImhYxe8P7-j4d8UW5OuDjVbvOt6DDyMhZgww69-4pExJ8lJsoffqWt6kPxeV9PF_RD4fnHoenYUAohx0ZUTJ2NooqOYiv04dchmvW1bzQY1nPvlkmyMMAdutXqzALWTK_D0iHdlirnDwaY-yrcxq3GRKBfQ30gLToXAUcTJIFs Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:28:12.640516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c283d74bc1404c078fa9c350c8acfe4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c283d74bc1404c078fa9c350c8acfe4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c283d74bc1404c078fa9c350c8acfe4a Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-727640434 Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 61d6214556954b778dc86a0d376a8d6e Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-AttachVolumeNegativeTest-727640434-project Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.642573 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'fc78d785-eb78-41fa-a9a2-6c87430ec7b9'} Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:28:12.643470 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. Jul 25 19:28:12.649659 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:28:12.651935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] Returning 404 to user: Instance fc78d785-eb78-41fa-a9a2-6c87430ec7b9 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:28:12.651935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fb182af0-8c30-4e3a-8e41-321fb2018723 tempest-AttachVolumeNegativeTest-727640434 tempest-AttachVolumeNegativeTest-727640434-project] 10.222.0.17 "GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9" status: 404 len: 111 microversion: 2.1 time: 0.056420 Jul 25 19:28:12.651935 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 599/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:28:12 2022] GET /compute/v2.1/servers/fc78d785-eb78-41fa-a9a2-6c87430ec7b9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:29:10.390395 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-55882667", "imageRef": "c08d9b05-64ae-4c38-a2d3-759be7bad53f", "flavorRef": "452"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:10.397618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:10.398277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:10.454863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] validate_networks() for None {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:29:10.744778 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:29:10.744989 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:29:10.745418 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:29:10.745829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:29:10.746373 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:29:10.755087 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:10.755576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:10.756339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:10.756775 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:10.776456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Getting quotas for project ce16719a27e24eaa8a8f77f33115e227. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:29:10.781845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Getting quotas for user 9fe36380cb9044e0acc1ab2ad7d4c1b3 and project ce16719a27e24eaa8a8f77f33115e227. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:29:10.793825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:29:10.796128 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c08d9b05-64ae-4c38-a2d3-759be7bad53f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:29:10.934045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7d5937db-dd1b-4a3c-859a-201cfe4dcaf4 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547852 Jul 25 19:29:10.934734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 624/1223] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 19:29:10.947969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-71e6e88a-66b5-412f-9f0f-f854cd540ece tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:10.947969 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-71e6e88a-66b5-412f-9f0f-f854cd540ece tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:10.949233 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:10.949588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:11.011866 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-71e6e88a-66b5-412f-9f0f-f854cd540ece tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:11.015774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-71e6e88a-66b5-412f-9f0f-f854cd540ece tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1213 microversion: 2.1 time: 0.074097 Jul 25 19:29:11.016304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 600/1224] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:10 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:12.038073 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3b50d707-a151-4af9-905e-34f98aa5daf7 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:12.038921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3b50d707-a151-4af9-905e-34f98aa5daf7 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:12.095595 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3b50d707-a151-4af9-905e-34f98aa5daf7 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:12.105913 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3b50d707-a151-4af9-905e-34f98aa5daf7 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1213 microversion: 2.1 time: 0.072352 Jul 25 19:29:12.106581 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 625/1225] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:12 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:13.127341 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-26195562-1285-4ab9-bc08-f3abacd56a14 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:13.127949 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-26195562-1285-4ab9-bc08-f3abacd56a14 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:13.190279 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-26195562-1285-4ab9-bc08-f3abacd56a14 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:13.198904 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-26195562-1285-4ab9-bc08-f3abacd56a14 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1213 microversion: 2.1 time: 0.075655 Jul 25 19:29:13.199332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 601/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:13 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:14.220357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0e0eb30f-c58e-4edf-ab86-bde9dc6d90ae tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:14.221162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0e0eb30f-c58e-4edf-ab86-bde9dc6d90ae tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:14.280038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0e0eb30f-c58e-4edf-ab86-bde9dc6d90ae tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:14.287090 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0e0eb30f-c58e-4edf-ab86-bde9dc6d90ae tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1213 microversion: 2.1 time: 0.070504 Jul 25 19:29:14.287497 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 626/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:14 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:15.310305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:15.311022 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:15.317891 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.318399 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.319194 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:15.319634 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:15.387712 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:15.401068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6ac415f2-0f0a-4a3d-af72-1e3692c38f41 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1217 microversion: 2.1 time: 0.095121 Jul 25 19:29:15.406892 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 602/1228] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:15 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:16.423868 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:16.424452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:16.431343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.433574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.433574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:16.433574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:16.499444 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:16.506165 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e67c6309-3044-44bb-83b4-a4b51060a5ec tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1217 microversion: 2.1 time: 0.086462 Jul 25 19:29:16.506761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 627/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:16 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:17.530696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:17.531276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:17.537716 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:17.538172 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:17.538987 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:17.539419 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:17.609521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:17.623301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6b59e158-5903-46bd-8c11-7b64c5bb092d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1273 microversion: 2.1 time: 0.097197 Jul 25 19:29:17.624234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 603/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:17 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:18.657576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:18.658224 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:18.667761 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:18.668452 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:18.669857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:18.670603 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.151202 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:19.159070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7679554b-c134-48c1-ba98-9d2bd3208903 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.505224 Jul 25 19:29:19.160056 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 628/1231] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:18 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:19.722419 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-113a27cc-be8a-4247-a03d-078b97eeac00 req-4f74069e-03dd-4dc5-bc99-77a5bd7d05d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4265b1-7313-4e4a-9e91-73c7a96d5ddc", "tag": "ac05206a-e783-4822-9de8-1bdd2fc54ce6"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:19.741254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-113a27cc-be8a-4247-a03d-078b97eeac00 req-4f74069e-03dd-4dc5-bc99-77a5bd7d05d6 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:19.741254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-113a27cc-be8a-4247-a03d-078b97eeac00 req-4f74069e-03dd-4dc5-bc99-77a5bd7d05d6 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:19.764576 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-113a27cc-be8a-4247-a03d-078b97eeac00 req-4f74069e-03dd-4dc5-bc99-77a5bd7d05d6 service nova] Creating event network-changed:ac05206a-e783-4822-9de8-1bdd2fc54ce6 for instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc on hv-cinder-82002 Jul 25 19:29:19.770149 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-113a27cc-be8a-4247-a03d-078b97eeac00 req-4f74069e-03dd-4dc5-bc99-77a5bd7d05d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053623 Jul 25 19:29:19.771090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 604/1232] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:20.193012 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:20.193617 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:20.201164 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.201615 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.202488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:20.202927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:20.436344 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:20.443526 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-8d29ecfc-7bf3-4b2e-8f1e-12d18f55215a tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.254295 Jul 25 19:29:20.444114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 629/1233] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:20 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:21.466592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:21.476605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:21.476605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.476605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:21.476605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:21.477024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:21.614637 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:21.623195 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bc712f59-ff16-42d8-ba5d-3ccd370ae3f3 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.161993 Jul 25 19:29:21.623790 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 605/1234] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:21 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:22.645100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:22.645696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:22.647565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:22.653629 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:22.654081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.660249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:22.660249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:22.796447 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:22.804651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-af04ba15-031c-4b96-a502-f5d440665645 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.163349 Jul 25 19:29:22.805228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 630/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:22 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:23.825955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:23.826976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:23.830463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=4 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:23.836296 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.836740 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.837516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:23.843422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:23.986555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:23.994139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0d30fa77-83f6-4cac-9ae9-369d0df3cf23 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.172777 Jul 25 19:29:23.994729 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 606/1236] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:23 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:25.016578 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:25.017237 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:25.019654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=10 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:25.024881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.025320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.026824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:25.027194 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:25.186738 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:25.190910 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-31a4da88-f9b7-4576-b3d6-cc17351028f1 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.178370 Jul 25 19:29:25.191487 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 631/1237] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:25 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:26.213008 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:26.214450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:26.221056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.221516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.222254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.222773 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.371543 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:26.379372 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bd860f58-29cb-4ee7-a83a-c8214b5b9aaa tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.170709 Jul 25 19:29:26.379954 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 607/1238] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:26 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:26.918815 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-5119aa86-644a-4fbf-8f60-4ba678f088c3 req-76420cf9-66d3-4ed0-9344-0d92b6c8dc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4265b1-7313-4e4a-9e91-73c7a96d5ddc", "name": "network-vif-plugged", "status": "completed", "tag": "ac05206a-e783-4822-9de8-1bdd2fc54ce6"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:26.928185 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-5119aa86-644a-4fbf-8f60-4ba678f088c3 req-76420cf9-66d3-4ed0-9344-0d92b6c8dc40 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:26.928624 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-5119aa86-644a-4fbf-8f60-4ba678f088c3 req-76420cf9-66d3-4ed0-9344-0d92b6c8dc40 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:26.950708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-5119aa86-644a-4fbf-8f60-4ba678f088c3 req-76420cf9-66d3-4ed0-9344-0d92b6c8dc40 service nova] Creating event network-vif-plugged:ac05206a-e783-4822-9de8-1bdd2fc54ce6 for instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc on hv-cinder-82002 Jul 25 19:29:26.950708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-5119aa86-644a-4fbf-8f60-4ba678f088c3 req-76420cf9-66d3-4ed0-9344-0d92b6c8dc40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151204 Jul 25 19:29:26.950708 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 632/1239] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:27.401730 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:27.402678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:27.410778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:27.411394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:27.412331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:27.412984 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:27.570383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:27.578643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fbf7adcc-568d-4ecf-8222-d323f2a2451d tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.181398 Jul 25 19:29:27.579229 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 608/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:27 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:28.609851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:28.610585 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:28.617220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.617737 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.618540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:28.618982 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:28.759398 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:28.768801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-eaf1602e-51fb-4218-9c68-3f4500745465 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1313 microversion: 2.1 time: 0.163667 Jul 25 19:29:28.769382 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 633/1241] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:28 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:29.791038 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:29.791844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:29.798531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.798986 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.799762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:29.800199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:29.959124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:29.967352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-327f9d7e-5f57-4ffb-9cf1-a0a3e7849742 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1462 microversion: 2.1 time: 0.180423 Jul 25 19:29:29.967943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 609/1242] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:29 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1462 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:30.014046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:30.014702 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:30.021713 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.022169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.023225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.023670 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.050627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:29:30.311065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-9629e2b6-19c5-4e7a-9163-4ea2a4c50f47 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 204 len: 0 microversion: 2.1 time: 0.301530 Jul 25 19:29:30.311652 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 634/1243] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:29:30 2022] DELETE /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:29:30.320158 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:30.320794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:30.326888 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.327330 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.328084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:30.328512 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:30.471237 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:30.479908 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9062fbd6-ce0c-42dc-be2d-f56613ff1b38 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1468 microversion: 2.1 time: 0.162944 Jul 25 19:29:30.480501 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 610/1244] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:30 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:31.502253 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:31.502984 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:31.509857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.510930 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.511729 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:31.512155 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:31.664127 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:31.672312 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2b7d4599-41ac-4ce2-8beb-42a871c82be5 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1468 microversion: 2.1 time: 0.174194 Jul 25 19:29:31.672703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 635/1245] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:31 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:29:32.258546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:29:32.259155 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:29:32.412078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-3c060dc3-4a33-40fc-aa37-6a7256425f12 req-ee508777-600d-4933-b63f-749c13a46c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4265b1-7313-4e4a-9e91-73c7a96d5ddc", "name": "network-vif-deleted", "tag": "ac05206a-e783-4822-9de8-1bdd2fc54ce6"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:29:32.423150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-3c060dc3-4a33-40fc-aa37-6a7256425f12 req-ee508777-600d-4933-b63f-749c13a46c74 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.423707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-3c060dc3-4a33-40fc-aa37-6a7256425f12 req-ee508777-600d-4933-b63f-749c13a46c74 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.438500 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-3c060dc3-4a33-40fc-aa37-6a7256425f12 req-ee508777-600d-4933-b63f-749c13a46c74 service nova] Creating event network-vif-deleted:ac05206a-e783-4822-9de8-1bdd2fc54ce6 for instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc on hv-cinder-82002 Jul 25 19:29:32.444928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-3c060dc3-4a33-40fc-aa37-6a7256425f12 req-ee508777-600d-4933-b63f-749c13a46c74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039602 Jul 25 19:29:32.446778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 611/1246] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:29:32.694678 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:32.695283 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:32.702303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.702807 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.703591 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.704029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.738810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:32.739162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:32.739618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.objects.instance [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lazy-loading 'fault' on Instance uuid fe4265b1-7313-4e4a-9e91-73c7a96d5ddc {{(pid=125166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:29:32.788020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe36380cb9044e0acc1ab2ad7d4c1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16719a27e24eaa8a8f77f33115e227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:29:32.796414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0a3be466-5d15-445d-8a01-7ba74048fdbe tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 200 len: 1303 microversion: 2.1 time: 0.105696 Jul 25 19:29:32.796993 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 636/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:32 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:29:33.819043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:29:33.819798 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] [instance: fe4265b1-7313-4e4a-9e91-73c7a96d5ddc] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:29:33.827822 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:33.828270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.829068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:29:33.829497 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:29:33.848163 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] HTTP exception thrown: Instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc could not be found. Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Request method failure captured: Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc HTTP/1.1 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3u8EAd-VAa_6GJP4tWGmzD7hhQ5NuNK_5YmIN0CVtohExM_Ax_TeB5awU_Y6hDJmQlkwRn50WwuQzcy_F9fxwvCyBQbLFIH-Fb1y79oagSycPueZFTocenWT8gRn2wppNEv-Z9Ww4ix5NeD-F1MAZW9fB1KCsChNoqd92kJJ_m3fVh8 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: ce16719a27e24eaa8a8f77f33115e227 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-VolumesNegativeTest-1429052105 Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:29:33.849843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ce16719a27e24eaa8a8f77f33115e227"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce16719a27e24eaa8a8f77f33115e227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ce16719a27e24eaa8a8f77f33115e227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ce16719a27e24eaa8a8f77f33115e227", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-VolumesNegativeTest-1429052105 Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: ce16719a27e24eaa8a8f77f33115e227 Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-VolumesNegativeTest-1429052105 Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-VolumesNegativeTest-1429052105-project Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 9fe36380cb9044e0acc1ab2ad7d4c1b3 Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-VolumesNegativeTest-1429052105-project Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc could not be found. Jul 25 19:29:33.852394 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'fe4265b1-7313-4e4a-9e91-73c7a96d5ddc'} Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc could not be found. Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:29:33.855110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc could not be found. Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc could not be found. Jul 25 19:29:33.858047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:29:33.861271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] Returning 404 to user: Instance fe4265b1-7313-4e4a-9e91-73c7a96d5ddc could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:29:33.861271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fc0d252d-62b7-49b2-8e68-044e200da2c2 tempest-VolumesNegativeTest-1429052105 tempest-VolumesNegativeTest-1429052105-project] 10.222.0.17 "GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc" status: 404 len: 111 microversion: 2.1 time: 0.036418 Jul 25 19:29:33.861271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 612/1248] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:29:33 2022] GET /compute/v2.1/servers/fe4265b1-7313-4e4a-9e91-73c7a96d5ddc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:30:05.097611 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0f7cc697-611e-4a1b-ae94-9bef72d878de tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Action: 'create', calling method: .version_select at 0x7fd8e5f8f5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1399739720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLBpSaFenGUTGZzJdSQWCV+KUGeidglgOi43WpTHO5xWsApuNQTxWyqWQwcagzEGFRmAGiwNveMLZ8jK1XYwkrWBgwpUwybOIjkpa4dD2ofcukXGE0lSFcWNQICU2ThpQ=="}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:05.103852 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:05.104531 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:05.115751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-0f7cc697-611e-4a1b-ae94-9bef72d878de tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Getting quotas for project c31a209e911b44eebde1216a909de48a. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:30:05.119660 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-0f7cc697-611e-4a1b-ae94-9bef72d878de tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Getting quotas for user 4df91b4cddab45f2ac7686e7c9fd00be and project c31a209e911b44eebde1216a909de48a. Resources: {'key_pairs'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:30:05.133235 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f7cc697-611e-4a1b-ae94-9bef72d878de tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [421aeb9c-ead8-4bbb-96bd-e3ab245e1b15] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:30:06.141311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f7cc697-611e-4a1b-ae94-9bef72d878de tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [421aeb9c-ead8-4bbb-96bd-e3ab245e1b15] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39802. Jul 25 19:30:06.249456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0f7cc697-611e-4a1b-ae94-9bef72d878de tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.156101 Jul 25 19:30:06.250071 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 637/1249] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:30:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:06.302819 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2076288278", "imageRef": "aff8cc86-2a54-4dc2-a76c-bf594d7a9c48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1399739720", "networks": [{"uuid": "ea6eca43-dae2-42e0-92b2-a3ff6a694e05"}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:06.312354 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=30 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:06.313024 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=54 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:06.364378 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] validate_networks() for [('ea6eca43-dae2-42e0-92b2-a3ff6a694e05', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:30:06.915471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:30:06.915895 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:30:06.916381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:30:06.916788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:30:06.917202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:30:06.927043 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:06.927521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:06.928334 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:06.928796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:06.946402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Getting quotas for project c31a209e911b44eebde1216a909de48a. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:30:06.954170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Getting quotas for user 4df91b4cddab45f2ac7686e7c9fd00be and project c31a209e911b44eebde1216a909de48a. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:30:06.962239 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:30:06.964591 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aff8cc86-2a54-4dc2-a76c-bf594d7a9c48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:30:07.145848 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-250a8c6c-fb1c-4a73-a85f-0dd18c27d227 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846781 Jul 25 19:30:07.146696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 613/1250] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:30:07.159487 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-826fdcb2-68e6-4eb2-8419-ef0add038aeb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:07.162858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-826fdcb2-68e6-4eb2-8419-ef0add038aeb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:07.222062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-826fdcb2-68e6-4eb2-8419-ef0add038aeb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:07.230469 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-826fdcb2-68e6-4eb2-8419-ef0add038aeb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1259 microversion: 2.1 time: 0.075382 Jul 25 19:30:07.231625 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 638/1251] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:07 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:08.253383 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:08.254018 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:08.260343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:08.261641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:08.261641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:08.262000 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:08.331462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:08.340120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e1628eff-40f7-4d3f-81e4-13e242fcade0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1263 microversion: 2.1 time: 0.091109 Jul 25 19:30:08.340893 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 614/1252] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:08 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:09.361774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:09.362355 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:09.369540 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:09.370278 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:09.371023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:09.371454 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:09.463981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:09.472703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0ee023db-b630-4e07-992d-8606b1aae328 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1319 microversion: 2.1 time: 0.114999 Jul 25 19:30:09.477773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 639/1253] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:09 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:10.496079 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:10.496823 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:10.504895 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:10.511104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:10.511104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:10.511104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:10.690763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:10.702012 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f52f1b19-5da8-4c43-bd3d-8630a5b7eb98 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.210362 Jul 25 19:30:10.703258 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 615/1254] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:10 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:11.735029 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:11.735696 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:11.742543 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:11.742992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:11.744042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:11.744730 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:11.903385 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:11.912633 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e7a3117d-4504-4e3b-a78b-97e0f6c0b3aa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.182016 Jul 25 19:30:11.913502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 640/1255] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:11 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:12.935230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:12.936422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:12.943498 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:12.944102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:12.944812 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:12.945324 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:13.108165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:13.116418 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d1ca7784-7245-40ea-99a0-ad170b4642f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.185113 Jul 25 19:30:13.130392 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 616/1256] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:12 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:14.140881 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:14.141890 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:14.155026 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:14.155580 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:14.156466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:14.156989 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:14.332767 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:14.335768 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-52d02aea-34cb-4cb6-836e-f4b6daf46748 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.201949 Jul 25 19:30:14.336502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 641/1257] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:14 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:30:15.357951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:15.358902 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:15.366610 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:15.367044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:15.367828 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:15.368460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:15.538210 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:15.548759 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e497656b-d881-4a28-a6b8-840d0293cf0e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.194497 Jul 25 19:30:15.551324 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 617/1258] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:15 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:16.573981 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:16.577797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:16.583792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:16.584231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:16.585037 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:16.585489 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:16.739020 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:16.748113 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-12f4931d-cfc4-45de-b087-ff824e5ff925 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.178121 Jul 25 19:30:16.749268 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 642/1259] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:16 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:17.770150 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:17.771068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:17.773570 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:17.774307 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:17.780859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:17.781466 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:17.782256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:17.782724 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:17.933465 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:17.941553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3aff88f1-0fa0-4fe3-815b-1b1c07c00035 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.175812 Jul 25 19:30:17.942148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 618/1260] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:17 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:18.912905 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-74945049-74c3-4113-ba16-9956360a3b84 req-304631b3-07c0-4364-8498-9d32fdbd0144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:18.918962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:18.935870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-74945049-74c3-4113-ba16-9956360a3b84 req-304631b3-07c0-4364-8498-9d32fdbd0144 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:18.935870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-74945049-74c3-4113-ba16-9956360a3b84 req-304631b3-07c0-4364-8498-9d32fdbd0144 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:18.947474 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-74945049-74c3-4113-ba16-9956360a3b84 req-304631b3-07c0-4364-8498-9d32fdbd0144 service nova] Creating event network-changed:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:30:18.954201 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-74945049-74c3-4113-ba16-9956360a3b84 req-304631b3-07c0-4364-8498-9d32fdbd0144 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045476 Jul 25 19:30:18.954853 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 643/1261] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:30:18.972165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:18.974846 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:18.979622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:18.980068 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:18.980840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:18.981269 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:19.132795 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:19.141078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0137744d-be60-4cb0-87cd-a3e52593b9f2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.174900 Jul 25 19:30:19.141660 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 619/1262] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:18 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:20.163836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:20.164537 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:20.172082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:20.172530 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:20.173303 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:20.173736 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:20.318398 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:20.326858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-46b87a6f-7dc4-4971-b1cd-9acf497eab11 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.167754 Jul 25 19:30:20.327432 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 644/1263] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:20 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:21.348780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:21.349365 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:21.356270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:21.356792 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:21.357899 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:21.358362 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:21.503499 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:21.516247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a97d81e5-0fb0-4240-9ca9-23a09579b3ef tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.171070 Jul 25 19:30:21.516881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 620/1264] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:21 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:30:22.537718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:22.538504 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:22.545251 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:22.545701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:22.546524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:22.546968 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:22.700073 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:22.707884 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-32f82b03-7d13-4805-88c9-f939558572e2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.174217 Jul 25 19:30:22.708456 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 645/1265] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:22 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:23.729643 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:23.730684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:23.738821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:23.739268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:23.740123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:23.740556 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:23.925309 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:23.937554 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-14683487-4695-4a78-befd-732e5673c803 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.211931 Jul 25 19:30:23.938460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 621/1266] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:23 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:24.959055 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:24.959658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:24.969746 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:24.970196 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:24.971032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:24.971466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:25.119108 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:25.126885 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a52c63c1-15de-4ebb-8733-9862eb7c32a2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.171829 Jul 25 19:30:25.127457 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 646/1267] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:24 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:26.148901 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:26.149462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:26.156154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:26.156599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:26.157358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:26.157788 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:26.298929 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:26.306936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a9fd40ea-f0b5-4d05-9fe8-3b23c4fc3724 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.161918 Jul 25 19:30:26.307516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 622/1268] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:26 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:27.328593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:27.329204 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:27.336488 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:27.336940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:27.337726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:27.338167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:27.494983 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:27.504445 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b9c04670-2d63-4187-a0c3-99053b1674b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.180322 Jul 25 19:30:27.505026 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 647/1269] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:27 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:28.527389 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:28.528069 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:28.535537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:28.535983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:28.536757 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:28.537198 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:28.679145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:28.686839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1f396400-2514-47a6-8c8c-1fc2462ccc58 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.163663 Jul 25 19:30:28.687513 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 623/1270] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:28 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:29.085675 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-d05ff343-022f-490b-abfc-2c636d936b08 req-5e5e8fe4-5388-4743-b673-3b97e6b6c30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "name": "network-vif-plugged", "status": "completed", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:29.096926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d05ff343-022f-490b-abfc-2c636d936b08 req-5e5e8fe4-5388-4743-b673-3b97e6b6c30e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:29.097371 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d05ff343-022f-490b-abfc-2c636d936b08 req-5e5e8fe4-5388-4743-b673-3b97e6b6c30e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:29.115959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-d05ff343-022f-490b-abfc-2c636d936b08 req-5e5e8fe4-5388-4743-b673-3b97e6b6c30e service nova] Creating event network-vif-plugged:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:30:29.116206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-d05ff343-022f-490b-abfc-2c636d936b08 req-5e5e8fe4-5388-4743-b673-3b97e6b6c30e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035410 Jul 25 19:30:29.117003 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 648/1271] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:29.707461 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:29.708074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:29.714942 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:29.715393 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:29.716175 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:29.716616 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:29.866106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:29.871182 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-db67bf8d-b0f7-45e7-91b6-44d890971624 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.167594 Jul 25 19:30:29.871763 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 624/1272] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:29 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:30.893833 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:30.894577 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:30.901404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:30.901848 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:30.902650 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:30.903078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:31.049264 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:31.058015 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-cad835c3-6f3b-41ea-a118-9c7227769abb tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1359 microversion: 2.1 time: 0.168669 Jul 25 19:30:31.058641 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 649/1273] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:30 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:32.080094 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:32.080706 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:32.086974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.087417 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.088186 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.088615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.226996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:32.235629 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e6c4fa8a-13e3-476d-a26c-43d16335975a tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1547 microversion: 2.1 time: 0.160104 Jul 25 19:30:32.236202 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 625/1274] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:32 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:32.256619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:32.258872 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:32.263921 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.264363 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.265129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.265657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.407797 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:32.415689 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-62bfccac-0a04-4fde-bcd0-2969e3657fa9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1547 microversion: 2.1 time: 0.162950 Jul 25 19:30:32.416265 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 650/1275] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:32 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:32.436011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:32.441482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:32.442262 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Searching by: {'deleted': False, 'project_id': 'c31a209e911b44eebde1216a909de48a'} {{(pid=125167) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 19:30:32.449389 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.449839 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.450670 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.451105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.546197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.multi_cell_list [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 19:30:32.681304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1cb78e6c-c7f0-4f9e-8f4f-399714ca8fb4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.249095 Jul 25 19:30:32.681896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 626/1276] 10.222.0.17 () {58 vars in 1125 bytes} [Mon Jul 25 19:30:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:32.694057 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:32.694732 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:32.700834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.701280 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.702049 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:32.702515 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:32.842050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:32.850734 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1b3a7ce3-2cc9-4aac-bf0b-1bcdd3227db1 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1547 microversion: 2.1 time: 0.160446 Jul 25 19:30:32.851436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 651/1277] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:32 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:30:34.820574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d8d8f4-bf85-42a5-b611-d0200c4f4564"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:34.823087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:34.831062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:34.831381 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:34.832130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:34.832562 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:35.582409 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3ac6e29b-625b-4beb-ac7e-d9920f2b1caa tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765842 Jul 25 19:30:35.583146 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 627/1278] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Jul 25 19:30:34 2022] POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:44.261748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:44.262393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:44.264514 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:44.265258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=70 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:44.270604 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:44.271048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:44.271824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:44.272247 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:44.408674 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:44.420375 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a5a41bd8-217b-4d78-ac36-bbd93a953349 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1593 microversion: 2.1 time: 0.162502 Jul 25 19:30:44.420998 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 652/1279] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:44 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:30:46.785369 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.786367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.787227 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.965434 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-6cc15bc6-4478-44bf-b498-43b9e44a11bc req-3b77d8b1-e1d4-4d97-99d9-ba72781f6186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:46.980402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-6cc15bc6-4478-44bf-b498-43b9e44a11bc req-3b77d8b1-e1d4-4d97-99d9-ba72781f6186 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:46.980859 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-6cc15bc6-4478-44bf-b498-43b9e44a11bc req-3b77d8b1-e1d4-4d97-99d9-ba72781f6186 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:46.997886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-6cc15bc6-4478-44bf-b498-43b9e44a11bc req-3b77d8b1-e1d4-4d97-99d9-ba72781f6186 service nova] Creating event network-changed:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:30:47.003338 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-6cc15bc6-4478-44bf-b498-43b9e44a11bc req-3b77d8b1-e1d4-4d97-99d9-ba72781f6186 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219265 Jul 25 19:30:47.004247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 628/1280] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:49.520759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1631614403"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:49.521343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:49.528094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:49.528542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:49.529353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:49.529790 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:49.669575 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.network.security_group_api [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Adding security group 705f0127-ded1-48a0-9f6f-e8c9bfb1dc5b to port 13a0ecd1-d927-41cb-9b33-c6e18a2f405e Jul 25 19:30:50.401914 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f634bcd5-3c23-4e09-93ed-f76d4415502c tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/action" status: 202 len: 0 microversion: 2.1 time: 0.886023 Jul 25 19:30:50.403160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 653/1281] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:30:49 2022] POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:30:50.418500 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-a43fa63d-d03d-4c76-8727-e648adc63cb2 req-d129b488-806d-4adb-8570-ae8f3e764b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:30:50.440238 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:30:50.440902 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-a43fa63d-d03d-4c76-8727-e648adc63cb2 req-d129b488-806d-4adb-8570-ae8f3e764b95 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:50.441353 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-a43fa63d-d03d-4c76-8727-e648adc63cb2 req-d129b488-806d-4adb-8570-ae8f3e764b95 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:50.442974 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:30:50.452510 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:50.452967 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:50.454263 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:30:50.454726 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:30:50.463726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-a43fa63d-d03d-4c76-8727-e648adc63cb2 req-d129b488-806d-4adb-8570-ae8f3e764b95 service nova] Creating event network-changed:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:30:50.472658 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-a43fa63d-d03d-4c76-8727-e648adc63cb2 req-d129b488-806d-4adb-8570-ae8f3e764b95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062601 Jul 25 19:30:50.473789 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 654/1282] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:30:50.669180 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:30:50.681254 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7f3bc5d2-e5f5-412d-b830-429ddb3f73c9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1758 microversion: 2.1 time: 0.272762 Jul 25 19:30:50.681775 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 629/1283] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:30:50 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1758 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:48.158079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:31:48.160492 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:48.162878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=6 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:48.163536 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=12 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:48.169181 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.169627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.170430 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.170863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.394988 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a673829e-87a6-4328-8fab-3a53c2bd79e3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/action" status: 202 len: 0 microversion: 2.1 time: 0.241081 Jul 25 19:31:48.395934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 655/1284] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:31:48 2022] POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:31:48.405622 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:48.412037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:48.412037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=4 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:48.412037 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=8 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:48.414265 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.414738 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.415656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:48.416611 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:48.573132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:48.581849 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f6845fb2-5a97-40ab-9860-4fe5cdb08a2e tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1750 microversion: 2.1 time: 0.180531 Jul 25 19:31:48.582505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 630/1285] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:48 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:49.606315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:49.607065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:49.614552 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:49.615027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:49.615817 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:49.616220 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:49.828027 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:49.836424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ffefa9db-1566-4105-9d6f-27718694dab7 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.236415 Jul 25 19:31:49.836992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 656/1286] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:49 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:50.859222 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:50.859844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:50.866612 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:50.867053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:50.867807 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:50.868234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:51.019786 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:51.028574 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-37c1c390-75b8-47a9-9fc3-0d72c3ab27a5 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.173134 Jul 25 19:31:51.029157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 631/1287] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:50 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:31:52.050763 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:52.051466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:52.058084 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:52.058573 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:52.059343 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:52.059779 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:52.206502 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:52.215166 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-24d9e10c-71ad-4956-88b1-3be6df8c0d6d tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.168133 Jul 25 19:31:52.215651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 657/1288] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:52 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:53.236471 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:53.237030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:53.244869 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:53.245310 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:53.246081 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:53.246546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:53.397285 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:53.405516 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-38e03c43-77c4-4013-94db-f8f6dfac6aa2 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.172993 Jul 25 19:31:53.406093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 632/1289] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:53 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:54.427349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:54.427912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:54.435765 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:54.436210 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:54.436991 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:54.437428 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:54.593261 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:54.601693 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f47a3baf-d25d-4447-9284-dae72b89885b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.178304 Jul 25 19:31:54.602271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 658/1290] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:54 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:55.623801 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:55.624435 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:55.631143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:55.631580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:55.632344 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:55.632765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:55.802086 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:55.811529 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-c3894e8b-67b8-4b55-b3e8-6749b60d4fd3 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.190709 Jul 25 19:31:55.812532 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 633/1291] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:55 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:56.832312 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:56.832939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:56.839953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:56.840397 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:56.841169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:56.841603 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:56.991721 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:57.000259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ccb442b5-db5b-42a4-aa4d-69a05df39e02 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.171834 Jul 25 19:31:57.000836 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 659/1292] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:56 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:31:58.022536 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:58.023161 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:58.030290 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:58.030770 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:58.031555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:58.031996 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:58.189420 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:58.197436 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-00e340cf-3cee-426f-9d24-3201d83c655f tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.178997 Jul 25 19:31:58.198843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 634/1293] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:58 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:31:59.219081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:31:59.219676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:31:59.226894 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:59.227327 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:59.228114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:31:59.228550 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:31:59.391938 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:31:59.400050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e6363d33-5c4f-4704-a59e-884ba25043b4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.184853 Jul 25 19:31:59.400623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 660/1294] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:31:59 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:00.426959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:00.426959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:00.430046 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:00.430527 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:00.431298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:00.431722 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:00.582375 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:00.590871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-ef4f5c67-dde8-449f-8dae-20c84fc5f025 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.172192 Jul 25 19:32:00.591447 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 635/1295] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:00 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:01.613703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:01.614391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:01.621377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:01.621824 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:01.622664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:01.623103 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:01.780949 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:01.795383 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-020fd785-bb2a-4cf5-b91a-3f4c5b4f7770 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.184607 Jul 25 19:32:01.795383 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 661/1296] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:01 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:02.817065 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:02.817749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:02.824713 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:02.825155 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:02.825924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:02.826385 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:02.978565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:02.987695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-aa09608d-d3ca-43ba-b86f-3346c6eeb5f6 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.174805 Jul 25 19:32:02.988289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 636/1297] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:02 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:04.009138 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:04.009748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:04.017366 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:04.017814 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:04.018631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:04.019074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:04.168218 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:04.176408 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-046edbf4-d89c-4d55-a0ed-1c387b242ac9 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.171168 Jul 25 19:32:04.176972 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 662/1298] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:04 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:05.198971 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:05.199591 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:05.206641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:05.207073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:05.207842 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:05.208266 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:05.374858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:05.383122 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4c049dcb-885a-471c-864c-28f065c735ad tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1755 microversion: 2.1 time: 0.188411 Jul 25 19:32:05.383708 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 637/1299] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:05 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:32:06.405845 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:32:06.406636 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:32:06.414021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:06.414349 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:06.415151 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:32:06.415586 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:32:06.569320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:32:06.578390 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f0e5e5f8-5971-4ae5-9ce0-ad26aec08276 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1758 microversion: 2.1 time: 0.176574 Jul 25 19:32:06.578977 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 663/1300] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:32:06 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:32:52.268925 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:32:52.269592 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:33:10.037680 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=16 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:10.038486 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=48 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:10.042485 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1631614403"}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:33:10.043019 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:10.049469 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.050605 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.050897 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.051119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.233565 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.network.security_group_api [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Removing security group 705f0127-ded1-48a0-9f6f-e8c9bfb1dc5b from port 13a0ecd1-d927-41cb-9b33-c6e18a2f405e Jul 25 19:33:10.646099 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-55c7c08e-07eb-4880-86bf-2d6a9a88b7cc tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/action" status: 202 len: 0 microversion: 2.1 time: 0.609997 Jul 25 19:33:10.655168 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=18 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:10.655912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:10.662111 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 638/1301] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Jul 25 19:33:10 2022] POST /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:33:10.670510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-b45a163e-5f6b-448a-92c8-017c498a87f8 req-d4e20615-1c8d-4b6b-b3fc-49252a1c1a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:33:10.694300 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-b45a163e-5f6b-448a-92c8-017c498a87f8 req-d4e20615-1c8d-4b6b-b3fc-49252a1c1a47 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:10.694774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-b45a163e-5f6b-448a-92c8-017c498a87f8 req-d4e20615-1c8d-4b6b-b3fc-49252a1c1a47 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:10.716120 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-b45a163e-5f6b-448a-92c8-017c498a87f8 req-d4e20615-1c8d-4b6b-b3fc-49252a1c1a47 service nova] Creating event network-changed:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:33:10.727908 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-b45a163e-5f6b-448a-92c8-017c498a87f8 req-d4e20615-1c8d-4b6b-b3fc-49252a1c1a47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074345 Jul 25 19:33:10.729048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 664/1302] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:12.046257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:12.046257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:12.046257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.046257 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.047164 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.047164 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.127433 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lazy-loading 'services' on Instance uuid 10e4ad28-d544-4b2d-bf03-4a7fdca67109 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:33:12.421366 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [63c18702-8ccb-439c-b778-a59cd68adc57] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:33:12.744726 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-630a05ef-6f2d-4c6b-a061-6f4a43f04a9d req-149a581d-256d-4f83-bbce-615971b6cd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:33:12.756046 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-630a05ef-6f2d-4c6b-a061-6f4a43f04a9d req-149a581d-256d-4f83-bbce-615971b6cd2b service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:12.756572 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-630a05ef-6f2d-4c6b-a061-6f4a43f04a9d req-149a581d-256d-4f83-bbce-615971b6cd2b service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:12.769042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-630a05ef-6f2d-4c6b-a061-6f4a43f04a9d req-149a581d-256d-4f83-bbce-615971b6cd2b service nova] Creating event network-changed:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:33:12.774377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-630a05ef-6f2d-4c6b-a061-6f4a43f04a9d req-149a581d-256d-4f83-bbce-615971b6cd2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034410 Jul 25 19:33:12.775074 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 665/1303] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:13.435256 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [63c18702-8ccb-439c-b778-a59cd68adc57] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40086. Jul 25 19:33:13.439368 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-265f0190-18fa-49db-b7e7-5721ffb83321 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments/79d8d8f4-bf85-42a5-b611-d0200c4f4564" status: 202 len: 0 microversion: 2.1 time: 1.411332 Jul 25 19:33:13.440097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 639/1304] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:33:12 2022] DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments/79d8d8f4-bf85-42a5-b611-d0200c4f4564 => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:33:13.449559 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:13.451873 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:13.458680 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:13.459992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:13.459992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:13.460380 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:13.489893 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-16bec49a-0149-4e43-8bc7-81365a890ad4 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Jul 25 19:33:13.490483 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 666/1305] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:13 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:33:14.504153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:14.506560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:14.512939 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.513382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.514143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:14.514607 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:14.544385 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-151b2f73-3c2f-4413-918d-9f5a34e6e00b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 Jul 25 19:33:14.544936 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 640/1306] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:14 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:15.556243 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:15.558422 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:15.565927 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.566410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.567182 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.567622 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.595857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-85f5bc9f-c77a-4438-9368-39cded0bba34 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043519 Jul 25 19:33:15.596463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 667/1307] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Jul 25 19:33:15 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 19:33:15.607496 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:15.608029 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:15.615247 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.615691 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.616450 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:15.616880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:15.695249 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] HTTP exception thrown: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 is not attached to volume 79d8d8f4-bf85-42a5-b611-d0200c4f4564 Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Request method failure captured: Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments/79d8d8f4-bf85-42a5-b611-d0200c4f4564 HTTP/1.1 Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3u8rLyH3F7yYtjYBkbxxNT_rBjwUPCbp3I63htA-x43-YniX_5yvwaz_E308xeaIqEaN4IcjSy1C2G_Pm79N7Pcy0pML00N8HckwdEDpAG7oK-hvUQF8Ugxgl5E89lxKDDtaTtlvMcJQqaC8SpUS7fG7RcKow65dsc1BOp-kBJXYfTA Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c31a209e911b44eebde1216a909de48a Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-TestMinimumBasicScenario-1727399783 Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:33:15.697014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c31a209e911b44eebde1216a909de48a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c31a209e911b44eebde1216a909de48a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c31a209e911b44eebde1216a909de48a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c31a209e911b44eebde1216a909de48a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-TestMinimumBasicScenario-1727399783 Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c31a209e911b44eebde1216a909de48a Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1727399783 Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-TestMinimumBasicScenario-1727399783-project Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 4df91b4cddab45f2ac7686e7c9fd00be Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-TestMinimumBasicScenario-1727399783-project Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:33:15.698843 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 is not attached to volume 79d8d8f4-bf85-42a5-b611-d0200c4f4564 Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'server_id': '10e4ad28-d544-4b2d-bf03-4a7fdca67109', 'id': '79d8d8f4-bf85-42a5-b611-d0200c4f4564'} Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 79d8d8f4-bf85-42a5-b611-d0200c4f4564. Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:33:15.699940 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 is not attached to volume 79d8d8f4-bf85-42a5-b611-d0200c4f4564 Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 is not attached to volume 79d8d8f4-bf85-42a5-b611-d0200c4f4564 Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:15.701588 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Returning 404 to user: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 is not attached to volume 79d8d8f4-bf85-42a5-b611-d0200c4f4564 {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:33:15.702931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-b941402d-e0f8-4fad-8918-12ad3d0084a0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments/79d8d8f4-bf85-42a5-b611-d0200c4f4564" status: 404 len: 154 microversion: 2.1 time: 0.095003 Jul 25 19:33:15.702931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 641/1308] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Jul 25 19:33:15 2022] DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109/os-volume_attachments/79d8d8f4-bf85-42a5-b611-d0200c4f4564 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:33:16.922901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:16.924177 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:16.930555 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.931002 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.931767 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:16.932267 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:16.957979 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:33:17.308662 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7c81d849-18b8-4e22-ad86-f511a0b01fac tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 204 len: 0 microversion: 2.1 time: 0.389294 Jul 25 19:33:17.309254 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 668/1309] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:33:16 2022] DELETE /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:33:17.317838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:17.318476 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:17.325021 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:17.325468 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.326234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:17.326708 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:17.474583 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:17.482421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-afb9ae39-4032-48c9-aac0-cf5c8df5f4ab tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1553 microversion: 2.1 time: 0.168614 Jul 25 19:33:17.482991 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 642/1310] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:17 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:18.504919 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:18.505623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:18.512259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.512710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.513480 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:18.513925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:18.645623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:18.653290 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a2d8a95b-7f86-405b-a0e0-7218c2f847d0 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1553 microversion: 2.1 time: 0.152781 Jul 25 19:33:18.653864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 669/1311] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:18 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:19.675297 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:19.675772 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:19.683462 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.683910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.687641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.687641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.754092 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-e92097e0-9c1c-4b55-88f6-9e93c2dcbd68 req-26923578-20a0-45a0-b9fa-d2aa8b217850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4ad28-d544-4b2d-bf03-4a7fdca67109", "name": "network-vif-deleted", "tag": "13a0ecd1-d927-41cb-9b33-c6e18a2f405e"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:33:19.757047 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df91b4cddab45f2ac7686e7c9fd00be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31a209e911b44eebde1216a909de48a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:33:19.765290 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-e92097e0-9c1c-4b55-88f6-9e93c2dcbd68 req-26923578-20a0-45a0-b9fa-d2aa8b217850 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:19.766032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f15d1314-247e-4184-99bc-987a799c8130 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 200 len: 1511 microversion: 2.1 time: 0.094491 Jul 25 19:33:19.766241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-e92097e0-9c1c-4b55-88f6-9e93c2dcbd68 req-26923578-20a0-45a0-b9fa-d2aa8b217850 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:19.766821 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 643/1312] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:19 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:33:19.779228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-e92097e0-9c1c-4b55-88f6-9e93c2dcbd68 req-26923578-20a0-45a0-b9fa-d2aa8b217850 service nova] Creating event network-vif-deleted:13a0ecd1-d927-41cb-9b33-c6e18a2f405e for instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 on hv-cinder-82002 Jul 25 19:33:19.784837 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-e92097e0-9c1c-4b55-88f6-9e93c2dcbd68 req-26923578-20a0-45a0-b9fa-d2aa8b217850 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101211 Jul 25 19:33:19.785451 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 670/1313] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:33:20.797283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:20.797875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] [instance: 10e4ad28-d544-4b2d-bf03-4a7fdca67109] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:33:20.805097 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.806950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.806950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:33:20.806950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:33:20.821295 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] HTTP exception thrown: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 could not be found. Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Request method failure captured: Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 HTTP/1.1 Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3u8rLyH3F7yYtjYBkbxxNT_rBjwUPCbp3I63htA-x43-YniX_5yvwaz_E308xeaIqEaN4IcjSy1C2G_Pm79N7Pcy0pML00N8HckwdEDpAG7oK-hvUQF8Ugxgl5E89lxKDDtaTtlvMcJQqaC8SpUS7fG7RcKow65dsc1BOp-kBJXYfTA Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: c31a209e911b44eebde1216a909de48a Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-TestMinimumBasicScenario-1727399783 Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:33:20.822858 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c31a209e911b44eebde1216a909de48a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c31a209e911b44eebde1216a909de48a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c31a209e911b44eebde1216a909de48a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c31a209e911b44eebde1216a909de48a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-TestMinimumBasicScenario-1727399783 Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: c31a209e911b44eebde1216a909de48a Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1727399783 Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-TestMinimumBasicScenario-1727399783-project Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 4df91b4cddab45f2ac7686e7c9fd00be Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-TestMinimumBasicScenario-1727399783-project Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 could not be found. Jul 25 19:33:20.824487 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': '10e4ad28-d544-4b2d-bf03-4a7fdca67109'} Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 could not be found. Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:33:20.825577 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 could not be found. Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 could not be found. Jul 25 19:33:20.827289 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:33:20.829246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Returning 404 to user: Instance 10e4ad28-d544-4b2d-bf03-4a7fdca67109 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:33:20.829246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-bbe094bc-f32e-4fba-8f93-b5927f2b0448 tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109" status: 404 len: 111 microversion: 2.1 time: 0.031003 Jul 25 19:33:20.829246 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 644/1314] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:33:20 2022] GET /compute/v2.1/servers/10e4ad28-d544-4b2d-bf03-4a7fdca67109 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:33:20.835748 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-eec547ed-0fab-435f-9775-248b1ceb169b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] Calling method '.version_select at 0x7fd8e5d2b550>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:33:20.909386 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-eec547ed-0fab-435f-9775-248b1ceb169b tempest-TestMinimumBasicScenario-1727399783 tempest-TestMinimumBasicScenario-1727399783-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1399739720" status: 202 len: 0 microversion: 2.1 time: 0.078962 Jul 25 19:33:20.910018 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 671/1315] 10.222.0.17 () {58 vars in 1272 bytes} [Mon Jul 25 19:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1399739720 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:33:41.485329 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:33:41.485943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:33:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:33:44.165299 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=14 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:44.166319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:44.335084 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-cc8f6b5f-0333-488a-a494-4b6af1ce4fb7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Action: 'create', calling method: .version_select at 0x7fd8ea3e3e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-509470960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkMn//b47VmQamyLYiagg+bgDkKNpJZkjldAzrX6FpTH01SQOpnzMvTMFuY8WFn9ICw5SqXHF1knpp2mDMW9anMbaGziIzJguaW26Mu42NRd/LDPWw0awjyfy2qeAjSoQ=="}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:33:44.352102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-cc8f6b5f-0333-488a-a494-4b6af1ce4fb7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for project 03519fbb6e4c42098f809f799c77f884. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:33:44.356300 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-cc8f6b5f-0333-488a-a494-4b6af1ce4fb7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for user 31413326a6de469e9d657d9ef3037cbe and project 03519fbb6e4c42098f809f799c77f884. Resources: {'key_pairs'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:33:44.441077 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-cc8f6b5f-0333-488a-a494-4b6af1ce4fb7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.281390 Jul 25 19:33:44.443183 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 645/1316] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Jul 25 19:33:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:09.980823 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:09.981676 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:09.985567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-867110965", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-509470960", "security_groups": [{"name": "tempest-secgroup-smoke-1977721220"}], "block_device_mapping_v2": [{"uuid": "facba99a-cedd-4629-9564-480b29c5855b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "98a3f6fd-f862-48c6-9d6c-13f87f3dacfa"}]}} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:34:10.105657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.network.neutron [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] validate_networks() for [('98a3f6fd-f862-48c6-9d6c-13f87f3dacfa', None, None, None, None, None)] {{(pid=125166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:34:10.593313 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Flavor limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:34:10.593742 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Image limits 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:34:10.594236 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Flavor pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:34:10.594670 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Image pref 0:0:0 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:34:10.595073 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.virt.hardware [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:34:10.604661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:10.605097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.605882 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:10.606315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:10.624068 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for project 03519fbb6e4c42098f809f799c77f884. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:34:10.628414 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.quota [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for user 31413326a6de469e9d657d9ef3037cbe and project 03519fbb6e4c42098f809f799c77f884. Resources: {'ram', 'cores', 'instances'} {{(pid=125166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:34:10.684819 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Going to run 1 instances... {{(pid=125166) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:34:10.686995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='facba99a-cedd-4629-9564-480b29c5855b',volume_size=None,volume_type=None)] {{(pid=125166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:34:11.015529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [95833094-cc29-4fef-97d0-3302d9c4ba2f] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:34:12.024546 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [95833094-cc29-4fef-97d0-3302d9c4ba2f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40412. Jul 25 19:34:12.029544 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-6262a152-2d67-4cac-9297-1a6b92d0878b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.050162 Jul 25 19:34:12.030199 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 672/1317] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:34:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:34:12.038671 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=4 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:12.043579 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:12.043579 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1c84563e-61c6-4757-9380-fbbc19c9cec2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:12.043975 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1c84563e-61c6-4757-9380-fbbc19c9cec2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:12.100045 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-1c84563e-61c6-4757-9380-fbbc19c9cec2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:12.108155 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1c84563e-61c6-4757-9380-fbbc19c9cec2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1093 microversion: 2.1 time: 0.070791 Jul 25 19:34:12.108854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 646/1318] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:12 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:13.132627 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-bccadfe1-c64a-4828-bc0e-2b7679f06fc9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:13.133443 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-bccadfe1-c64a-4828-bc0e-2b7679f06fc9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:13.199564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-bccadfe1-c64a-4828-bc0e-2b7679f06fc9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:13.206598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-bccadfe1-c64a-4828-bc0e-2b7679f06fc9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1093 microversion: 2.1 time: 0.078583 Jul 25 19:34:13.207259 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 673/1319] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:13 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:14.230129 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-895f9b44-62ca-44aa-a3fa-9df23191ab50 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:14.230794 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-895f9b44-62ca-44aa-a3fa-9df23191ab50 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:14.290147 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-895f9b44-62ca-44aa-a3fa-9df23191ab50 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:14.297696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-895f9b44-62ca-44aa-a3fa-9df23191ab50 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1093 microversion: 2.1 time: 0.072866 Jul 25 19:34:14.298305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 647/1320] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:14 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:15.327038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-42846009-c491-4821-93a2-9b11eb125ea5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:15.328023 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-42846009-c491-4821-93a2-9b11eb125ea5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:15.390565 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-42846009-c491-4821-93a2-9b11eb125ea5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:15.397863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-42846009-c491-4821-93a2-9b11eb125ea5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1093 microversion: 2.1 time: 0.075605 Jul 25 19:34:15.398374 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 674/1321] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:15 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:16.418902 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:16.419552 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:16.427508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:16.427955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:16.429036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:16.430014 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:16.505408 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:16.513891 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-d63cef2d-00c8-4a58-8a7a-654f316e150b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1143 microversion: 2.1 time: 0.098878 Jul 25 19:34:16.514503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 648/1322] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:16 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:17.535770 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:17.538710 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:17.544404 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.544880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.545656 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:17.546097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:17.620334 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:17.627983 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-49d8df74-e957-43e1-9cbc-a037c3af2866 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1209 microversion: 2.1 time: 0.096035 Jul 25 19:34:17.628567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 675/1323] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:17 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:18.649656 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:18.650267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:18.656851 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.657297 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.658060 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:18.658526 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:18.812767 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:18.823948 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-69f67236-31a7-424a-a1f0-be1a62e812cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1277 microversion: 2.1 time: 0.178240 Jul 25 19:34:18.824785 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 649/1324] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:18 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:19.171840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-ed6c6939-2088-49b9-93d7-d987ccfcedd9 req-f2f8b3ab-a62f-4a8f-ae9c-8a7e65d76461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93e2b8b-7ee2-45b5-a777-ccd004626b28", "tag": "cd738013-8096-4e5b-8520-aa4af7ced743"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:34:19.190048 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-ed6c6939-2088-49b9-93d7-d987ccfcedd9 req-f2f8b3ab-a62f-4a8f-ae9c-8a7e65d76461 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.190864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-ed6c6939-2088-49b9-93d7-d987ccfcedd9 req-f2f8b3ab-a62f-4a8f-ae9c-8a7e65d76461 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:19.208647 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-ed6c6939-2088-49b9-93d7-d987ccfcedd9 req-f2f8b3ab-a62f-4a8f-ae9c-8a7e65d76461 service nova] Creating event network-changed:cd738013-8096-4e5b-8520-aa4af7ced743 for instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 on hv-cinder-82002 Jul 25 19:34:19.216039 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-ed6c6939-2088-49b9-93d7-d987ccfcedd9 req-f2f8b3ab-a62f-4a8f-ae9c-8a7e65d76461 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063987 Jul 25 19:34:19.216889 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 676/1325] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:19.847429 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:19.848382 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:19.855595 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.856134 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:19.857271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:19.857920 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:20.018234 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:20.027663 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-77211d91-acf3-45d3-b744-a424462943ec tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.184021 Jul 25 19:34:20.028277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 650/1326] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:19 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:21.047961 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:21.052506 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:21.053632 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:21.060599 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.061097 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.062014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:21.062481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:21.208062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:21.216301 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-83ee6384-c51d-4db1-8871-e9f72edc83af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.169961 Jul 25 19:34:21.216870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 677/1327] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:21 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:22.238463 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:22.239123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:22.246438 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.246955 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.247789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:22.248275 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:22.405575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:22.415489 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9621455c-ae3e-462d-ac3b-c6d7f69660a5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.180853 Jul 25 19:34:22.416093 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 651/1328] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:22 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:23.437657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:23.438462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:23.445750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.446193 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.450391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:23.450391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:23.584271 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:23.592654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ace4f4a5-1077-4791-8f9c-6f5df100a689 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.159678 Jul 25 19:34:23.593209 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 678/1329] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:23 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:24.621789 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:24.622928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:24.626684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=4 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:24.634965 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:24.635749 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.637078 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:24.637931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:24.780337 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:24.788697 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-386acd49-8219-46cd-9b19-c586896aed06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.175950 Jul 25 19:34:24.789273 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 652/1330] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:24 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:25.810190 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:25.810866 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:25.813172 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=10 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:34:25.818319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.821277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.821277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:25.821277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:25.971901 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:25.980364 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b1ab4d52-0553-405b-9865-59c80e2e73af tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.174114 Jul 25 19:34:25.981014 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 679/1331] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:25 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:34:27.001304 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:27.001928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:27.009431 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.009926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.010762 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:27.011199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:27.151531 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:27.160124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a96b0dcd-7db5-4f00-87cf-fa28254eb714 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.162719 Jul 25 19:34:27.160707 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 653/1332] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:26 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:28.181025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:28.181630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:28.188308 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.188750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.189512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:28.189942 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:28.332865 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:28.341564 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-342c578a-4a0e-439b-9200-6046cdfcf1ee tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.164504 Jul 25 19:34:28.342692 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 680/1333] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:28 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:29.363822 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:29.364614 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:29.372454 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:29.372905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:29.373679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:29.374110 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:29.523576 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:29.531854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-78c858ee-2125-4ccc-9673-ddb8d8ca6d79 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.172566 Jul 25 19:34:29.532780 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 654/1334] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:29 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:30.554184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:30.554933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:30.561583 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.562021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.562810 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:30.563238 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:30.703606 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:30.712024 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3c85c3e8-1e57-424b-8b01-0e224f79dd6a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.162516 Jul 25 19:34:30.712597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 681/1335] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:30 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:31.733421 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:31.734063 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:31.740293 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.741369 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.742083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:31.742553 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:31.878696 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:31.893332 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-4498ed0f-18ce-4af2-88e2-292caf5e0510 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.163598 Jul 25 19:34:31.893706 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 655/1336] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:31 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:32.286623 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-d1b204ca-d7af-421a-8831-05d3b92874b1 req-ab0987a0-682b-4716-999b-bfb1e48448a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93e2b8b-7ee2-45b5-a777-ccd004626b28", "name": "network-vif-plugged", "status": "completed", "tag": "cd738013-8096-4e5b-8520-aa4af7ced743"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:34:32.298695 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d1b204ca-d7af-421a-8831-05d3b92874b1 req-ab0987a0-682b-4716-999b-bfb1e48448a4 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.300463 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-d1b204ca-d7af-421a-8831-05d3b92874b1 req-ab0987a0-682b-4716-999b-bfb1e48448a4 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.313796 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-d1b204ca-d7af-421a-8831-05d3b92874b1 req-ab0987a0-682b-4716-999b-bfb1e48448a4 service nova] Creating event network-vif-plugged:cd738013-8096-4e5b-8520-aa4af7ced743 for instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 on hv-cinder-82002 Jul 25 19:34:32.320114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-d1b204ca-d7af-421a-8831-05d3b92874b1 req-ab0987a0-682b-4716-999b-bfb1e48448a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141705 Jul 25 19:34:32.320744 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 682/1337] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:34:32.915422 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:32.916114 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:32.923059 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.923626 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:32.924520 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:32.925044 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:33.074508 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:33.082087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e518112b-a710-4c85-bec0-b80a50eaba06 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.171483 Jul 25 19:34:33.082714 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 656/1338] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:32 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:34.104593 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:34.105279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:34.112228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:34.112671 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.113427 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:34.113857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:34.256909 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:34.265877 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e623e118-1964-49de-84e7-656dbbe2a483 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1265 microversion: 2.1 time: 0.166048 Jul 25 19:34:34.266480 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 683/1339] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:34 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:35.289868 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:35.291006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:35.299796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.300245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.301027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.302133 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.449482 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:35.454769 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-766628d1-165d-43d1-9c2c-dc79f3c62398 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1452 microversion: 2.1 time: 0.171276 Jul 25 19:34:35.455343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 657/1340] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:35 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:35.476320 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:34:35.476946 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:34:35.483551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.486000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.486000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:35.486000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:35.628205 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:34:35.636368 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c808512a-de41-457e-b807-2f2c5d3a854b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1452 microversion: 2.1 time: 0.164386 Jul 25 19:34:35.636936 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 684/1341] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:34:35 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:34:37.980905 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-ddd54a58-e78e-482f-9808-96fbc7962e1c req-f327858d-e0fb-4fe0-bf7b-b0fe72a0d91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93e2b8b-7ee2-45b5-a777-ccd004626b28", "tag": "cd738013-8096-4e5b-8520-aa4af7ced743"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:34:37.992446 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-ddd54a58-e78e-482f-9808-96fbc7962e1c req-f327858d-e0fb-4fe0-bf7b-b0fe72a0d91d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:34:37.992895 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-ddd54a58-e78e-482f-9808-96fbc7962e1c req-f327858d-e0fb-4fe0-bf7b-b0fe72a0d91d service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:34:38.007319 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-ddd54a58-e78e-482f-9808-96fbc7962e1c req-f327858d-e0fb-4fe0-bf7b-b0fe72a0d91d service nova] Creating event network-changed:cd738013-8096-4e5b-8520-aa4af7ced743 for instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 on hv-cinder-82002 Jul 25 19:34:38.013036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-ddd54a58-e78e-482f-9808-96fbc7962e1c req-f327858d-e0fb-4fe0-bf7b-b0fe72a0d91d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035880 Jul 25 19:34:38.013684 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 658/1342] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:36:12.277871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:36:12.278682 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:36:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:36:53.259639 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 19:36:53.260499 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:53.261244 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=54 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:53.265104 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:53.265618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:53.271740 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.272202 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.273004 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.273458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.301269 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Going to try to terminate instance {{(pid=125166) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:36:53.526777 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-08cbfbd0-f05a-462b-a3d7-4ce19edd2160 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 204 len: 0 microversion: 2.1 time: 0.268984 Jul 25 19:36:53.527479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 685/1343] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:36:53 2022] DELETE /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:36:53.534931 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b138282-a42c-4de3-8cb6-44c8475267a9] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 19:36:53.535547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=30 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:53.536296 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=62 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:36:53.541214 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:53.541926 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:53.548241 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.554132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.554132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:53.554132 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:53.690203 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:53.697871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e476c147-bd06-44cf-a3f1-54004e1f0fcd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1577 microversion: 2.1 time: 0.165905 Jul 25 19:36:53.698460 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 659/1344] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:53 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:54.720800 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:54.721525 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:54.730272 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:54.730743 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:54.731510 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:54.731944 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:54.737518 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40538. Jul 25 19:36:54.939470 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:54.947208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5b916dd1-7844-4a9d-bf7a-6bab3cb1a265 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1577 microversion: 2.1 time: 0.230892 Jul 25 19:36:54.947774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 686/1345] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:54 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:55.968928 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:55.969475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:55.977137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:55.979245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:55.979245 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:55.979558 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:55.985686 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b138282-a42c-4de3-8cb6-44c8475267a9] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40544. Jul 25 19:36:56.045312 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:56.053140 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-fdcbc705-a594-435f-81b4-3019051096b7 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1509 microversion: 2.1 time: 0.088216 Jul 25 19:36:56.053699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 660/1346] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:55 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:56.144010 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-2a04a002-dab5-40e8-8584-bcd72e691fdd req-32691a5b-d7d2-413c-adb4-ba8e7c2cd5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93e2b8b-7ee2-45b5-a777-ccd004626b28", "name": "network-vif-deleted", "tag": "cd738013-8096-4e5b-8520-aa4af7ced743"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:36:56.155063 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-2a04a002-dab5-40e8-8584-bcd72e691fdd req-32691a5b-d7d2-413c-adb4-ba8e7c2cd5c7 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:56.159925 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-2a04a002-dab5-40e8-8584-bcd72e691fdd req-32691a5b-d7d2-413c-adb4-ba8e7c2cd5c7 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:56.168933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-2a04a002-dab5-40e8-8584-bcd72e691fdd req-32691a5b-d7d2-413c-adb4-ba8e7c2cd5c7 service nova] Creating event network-vif-deleted:cd738013-8096-4e5b-8520-aa4af7ced743 for instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 on hv-cinder-82002 Jul 25 19:36:56.174032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-2a04a002-dab5-40e8-8584-bcd72e691fdd req-32691a5b-d7d2-413c-adb4-ba8e7c2cd5c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Jul 25 19:36:56.175269 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 687/1347] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:36:57.076059 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:57.076665 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:57.083514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.083896 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.085109 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.085109 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.121693 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:57.122138 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:57.122609 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.objects.instance [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lazy-loading 'fault' on Instance uuid d93e2b8b-7ee2-45b5-a777-ccd004626b28 {{(pid=125167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 19:36:57.166244 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:57.174010 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-261130a5-29c9-473b-a7cf-1ab54850513d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 200 len: 1229 microversion: 2.1 time: 0.102914 Jul 25 19:36:57.174854 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 661/1348] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:57 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:36:58.196284 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:58.197529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:58.203864 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.204316 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.205088 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.205554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.219467 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] HTTP exception thrown: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Request method failure captured: Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 HTTP/1.1 Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3vARaTeynYHjHjFCXe7Kbs2MEtLiluWCBtcdRZo3l7XR9td3FzPRWFQGshNXfvofr54nuQRalhja-0oyPrVmAsYcVezJt-1wKzdGERY1VCgunkpHtsG4WZgQO9M3ZBU1OWTRVRKGRtTqZrSaLNh9OyKsL_dOtDsOGfvP-7RtTBiifFI Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:36:58.221388 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_03519fbb6e4c42098f809f799c77f884", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 31413326a6de469e9d657d9ef3037cbe Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:36:58.223231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'd93e2b8b-7ee2-45b5-a777-ccd004626b28'} Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:36:58.224339 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:36:58.226021 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:36:58.227570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Returning 404 to user: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:36:58.227570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-164078b6-de7c-426a-bccb-ee5090e3e3da tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 404 len: 111 microversion: 2.1 time: 0.031355 Jul 25 19:36:58.227570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 688/1349] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:58 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:36:58.280640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-486827869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-509470960", "security_groups": [{"name": "tempest-secgroup-smoke-1977721220"}], "block_device_mapping_v2": [{"uuid": "facba99a-cedd-4629-9564-480b29c5855b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "98a3f6fd-f862-48c6-9d6c-13f87f3dacfa"}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:36:58.396331 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] validate_networks() for [('98a3f6fd-f862-48c6-9d6c-13f87f3dacfa', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:36:58.817673 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:36:58.818090 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:36:58.818600 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:36:58.818989 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:36:58.819401 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:36:58.829049 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.829492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.830298 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:36:58.830765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:36:58.848308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for project 03519fbb6e4c42098f809f799c77f884. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:36:58.852423 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for user 31413326a6de469e9d657d9ef3037cbe and project 03519fbb6e4c42098f809f799c77f884. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:36:58.913855 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:36:58.915976 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='facba99a-cedd-4629-9564-480b29c5855b',volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:36:59.316505 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-98bb05ba-310d-42ee-91e7-41aac68145a2 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.039698 Jul 25 19:36:59.317370 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 662/1350] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:36:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:36:59.329871 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-abb6b4a0-3c37-41ee-8d59-2b50091e9d80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:36:59.330568 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-abb6b4a0-3c37-41ee-8d59-2b50091e9d80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:36:59.389142 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-abb6b4a0-3c37-41ee-8d59-2b50091e9d80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:36:59.396912 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-abb6b4a0-3c37-41ee-8d59-2b50091e9d80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1093 microversion: 2.1 time: 0.071937 Jul 25 19:36:59.397478 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 689/1351] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:36:59 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:00.417833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:00.419359 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:00.426025 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:00.426499 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:00.427268 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:00.427701 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:00.492138 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:00.501230 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0e0e8f92-b791-48ee-864c-ccc433384e80 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1143 microversion: 2.1 time: 0.087862 Jul 25 19:37:00.501802 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 663/1352] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:00 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:01.496806 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:37:01.497458 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:37:01.522609 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:01.523225 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:01.534258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:01.534258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:01.534258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:01.534258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:01.641834 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:01.654249 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5661807e-0f50-4c34-9a8c-a75746b47a28 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1209 microversion: 2.1 time: 0.135472 Jul 25 19:37:01.666481 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 690/1353] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:01 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:02.680347 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:02.681687 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:02.693126 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:02.693881 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:02.695343 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:02.696367 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:02.894459 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:02.903825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-09e2c39a-4ab2-4248-bb17-81ae1806ee29 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1277 microversion: 2.1 time: 0.230396 Jul 25 19:37:02.904547 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 664/1354] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:02 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:03.063964 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-51a7e174-dbfd-43e4-a4ce-aee2d9c950e0 req-c830bfbe-bff4-4d7b-b947-71bc773f687c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36cbe37-058f-4dc2-903f-7450b95e0c19", "tag": "08532af4-2657-41b3-95af-eafa559bdf33"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:37:03.075516 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-51a7e174-dbfd-43e4-a4ce-aee2d9c950e0 req-c830bfbe-bff4-4d7b-b947-71bc773f687c service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.075974 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-51a7e174-dbfd-43e4-a4ce-aee2d9c950e0 req-c830bfbe-bff4-4d7b-b947-71bc773f687c service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:03.093731 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-51a7e174-dbfd-43e4-a4ce-aee2d9c950e0 req-c830bfbe-bff4-4d7b-b947-71bc773f687c service nova] Creating event network-changed:08532af4-2657-41b3-95af-eafa559bdf33 for instance d36cbe37-058f-4dc2-903f-7450b95e0c19 on hv-cinder-82002 Jul 25 19:37:03.099124 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-51a7e174-dbfd-43e4-a4ce-aee2d9c950e0 req-c830bfbe-bff4-4d7b-b947-71bc773f687c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Jul 25 19:37:03.099826 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 691/1355] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:37:03.925072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:03.925655 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:03.932139 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.932677 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:03.933444 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:03.934027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:04.069833 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:04.078007 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-50ff7876-23b8-483f-8cd6-53b64e52da88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.156966 Jul 25 19:37:04.078596 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 665/1356] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:03 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:05.101162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:05.101861 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:05.109304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:05.109746 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:05.110567 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:05.111024 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:05.245851 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:05.253512 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-dcff5338-f49f-4a6d-a709-e4d03803e226 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.157171 Jul 25 19:37:05.254075 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 692/1357] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:05 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:06.274410 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:06.275087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:06.281606 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:06.282053 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:06.282852 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:06.283292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:06.414752 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:06.422840 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3effa600-d006-40c8-9e62-c00d7a122d71 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.152346 Jul 25 19:37:06.423402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 666/1358] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:06 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:07.444651 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:07.445270 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:07.451962 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:07.452410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:07.453376 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:07.454036 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:07.620258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:07.628030 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-96c33197-6a90-4063-99e7-4e9a172a3d32 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.187278 Jul 25 19:37:07.628597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 693/1359] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:07 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:08.651488 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:08.652211 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:08.658715 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:08.659157 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:08.659906 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:08.660361 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:08.789128 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:08.797165 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-6878c7e8-6ecd-45fd-bf94-e7cb2b14b6cc tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.150519 Jul 25 19:37:08.797721 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 667/1360] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:08 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:09.818683 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:09.819277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:09.821707 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=2 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:37:09.826926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:09.833062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:09.833062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:09.833062 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:09.967361 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:09.975179 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-46910e2b-a840-4ce8-b27e-47535f44347f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.160501 Jul 25 19:37:09.975750 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 694/1361] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:09 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:10.996927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:10.997726 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:10.999404 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:37:11.000103 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=6 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:37:11.005397 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:11.013514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:11.013514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:11.013514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:11.148124 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:11.159506 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-dbe2aca6-57f9-4d8e-948e-fae36255843c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.167149 Jul 25 19:37:11.160087 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 668/1362] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:10 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:12.180896 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:12.181542 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:12.189162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:12.189648 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:12.190576 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:12.191070 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:12.327529 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:12.335545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-a9376adc-5629-435b-a93c-8b530b8c3c35 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.158663 Jul 25 19:37:12.336109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 695/1363] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:12 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:13.357557 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:13.358276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:13.364825 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:13.365271 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:13.366027 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:13.366492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:13.501560 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:13.509641 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-f4acb238-229e-4bb7-956f-b501621c0701 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.156468 Jul 25 19:37:13.510131 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 669/1364] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:13 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:14.531379 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:14.531980 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:14.538590 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:14.539040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:14.539808 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:14.540242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:14.679169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:14.687556 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-070ba921-3ec7-4c7d-8b16-0d96f23cc929 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.160033 Jul 25 19:37:14.688160 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 696/1365] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:14 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:37:14.829492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-87a608ea-066a-4444-ba9d-a1a4ce6c7a49 req-3b79927b-f645-43f0-9ac1-3b3daab9def4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36cbe37-058f-4dc2-903f-7450b95e0c19", "name": "network-vif-plugged", "status": "completed", "tag": "08532af4-2657-41b3-95af-eafa559bdf33"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:37:14.839951 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-87a608ea-066a-4444-ba9d-a1a4ce6c7a49 req-3b79927b-f645-43f0-9ac1-3b3daab9def4 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:14.840397 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-87a608ea-066a-4444-ba9d-a1a4ce6c7a49 req-3b79927b-f645-43f0-9ac1-3b3daab9def4 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:14.851667 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-87a608ea-066a-4444-ba9d-a1a4ce6c7a49 req-3b79927b-f645-43f0-9ac1-3b3daab9def4 service nova] Creating event network-vif-plugged:08532af4-2657-41b3-95af-eafa559bdf33 for instance d36cbe37-058f-4dc2-903f-7450b95e0c19 on hv-cinder-82002 Jul 25 19:37:14.857056 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-87a608ea-066a-4444-ba9d-a1a4ce6c7a49 req-3b79927b-f645-43f0-9ac1-3b3daab9def4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031123 Jul 25 19:37:14.857608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 670/1366] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:37:15.707995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:15.708599 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:15.715956 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:15.716397 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:15.717167 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:15.717598 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:15.854959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:15.862545 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-7f416c06-30ad-46b0-bc0b-cdc3df75b52f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.158427 Jul 25 19:37:15.863112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 697/1367] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:15 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:16.883992 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:16.884755 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:16.892199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:16.892654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:16.893440 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:16.893876 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:17.036199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:17.044983 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-97afd047-d8d6-41ed-8354-250aa1857945 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1265 microversion: 2.1 time: 0.165196 Jul 25 19:37:17.045550 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 671/1368] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:16 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:18.065315 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:18.065933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:18.072630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:18.073079 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:18.073840 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:18.074277 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:18.209431 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:18.217391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-627fc2e6-16f7-4461-83ab-f71d4306a321 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1452 microversion: 2.1 time: 0.155975 Jul 25 19:37:18.217948 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 698/1369] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:18 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:18.238427 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:37:18.239028 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:37:18.245479 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:18.245911 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:18.246817 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:18.247941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:18.378615 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:37:18.386145 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-36462dac-9d67-4f1f-acd7-2dacd9ac18a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1452 microversion: 2.1 time: 0.151539 Jul 25 19:37:18.386742 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 672/1370] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:37:18 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:37:20.438561 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-92fa1c5a-b961-4cfd-9adf-eb916709fcf6 req-37bfcec3-aa8d-46a6-87d9-94f1ca4aac8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36cbe37-058f-4dc2-903f-7450b95e0c19", "tag": "08532af4-2657-41b3-95af-eafa559bdf33"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:37:20.448340 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-92fa1c5a-b961-4cfd-9adf-eb916709fcf6 req-37bfcec3-aa8d-46a6-87d9-94f1ca4aac8e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:37:20.448781 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-92fa1c5a-b961-4cfd-9adf-eb916709fcf6 req-37bfcec3-aa8d-46a6-87d9-94f1ca4aac8e service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:37:20.461208 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-92fa1c5a-b961-4cfd-9adf-eb916709fcf6 req-37bfcec3-aa8d-46a6-87d9-94f1ca4aac8e service nova] Creating event network-changed:08532af4-2657-41b3-95af-eafa559bdf33 for instance d36cbe37-058f-4dc2-903f-7450b95e0c19 on hv-cinder-82002 Jul 25 19:37:20.467351 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-92fa1c5a-b961-4cfd-9adf-eb916709fcf6 req-37bfcec3-aa8d-46a6-87d9-94f1ca4aac8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095235 Jul 25 19:37:20.467951 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 699/1371] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:39:23.312490 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:23.313276 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=78 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:23.317539 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-449707685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-509470960", "security_groups": [{"name": "tempest-secgroup-smoke-1977721220"}], "block_device_mapping_v2": [{"uuid": "9ced0f40-b630-4a2c-bd95-80ef0b685488", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "98a3f6fd-f862-48c6-9d6c-13f87f3dacfa"}]}} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:39:23.489627 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.network.neutron [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] validate_networks() for [('98a3f6fd-f862-48c6-9d6c-13f87f3dacfa', None, None, None, None, None)] {{(pid=125167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 19:39:24.100154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Flavor limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 19:39:24.100567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Image limits 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 19:39:24.101072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Flavor pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 19:39:24.101475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Image pref 0:0:0 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 19:39:24.101882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.virt.hardware [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 19:39:24.110982 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:24.111424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:24.112216 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:24.112645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:24.129828 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for project 03519fbb6e4c42098f809f799c77f884. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 19:39:24.133887 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.quota [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Getting quotas for user 31413326a6de469e9d657d9ef3037cbe and project 03519fbb6e4c42098f809f799c77f884. Resources: {'ram', 'cores', 'instances'} {{(pid=125167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 19:39:24.192838 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Going to run 1 instances... {{(pid=125167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 19:39:24.194943 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ced0f40-b630-4a2c-bd95-80ef0b685488',volume_size=None,volume_type=None)] {{(pid=125167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 19:39:24.515006 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 19:39:24.891673 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:39:24.892257 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:39:25.523959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [f8684267-37a1-40af-b65d-1b2f13ef0608] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40720. Jul 25 19:39:25.529457 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-1feae8da-d0c2-40bd-be02-b687c30ad00a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.218580 Jul 25 19:39:25.530639 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 673/1372] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Jul 25 19:39:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 19:39:25.540940 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 19:39:25.541862 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:25.542660 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:25.547724 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-c526c7a8-37d9-4289-ac9c-bd49552f1a94 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:25.547955 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-c526c7a8-37d9-4289-ac9c-bd49552f1a94 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:25.606759 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-c526c7a8-37d9-4289-ac9c-bd49552f1a94 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:25.614305 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-c526c7a8-37d9-4289-ac9c-bd49552f1a94 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1093 microversion: 2.1 time: 0.075151 Jul 25 19:39:25.617162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 700/1373] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:25 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:26.635679 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-7dd5ad15-7393-4cf7-8b17-70e64f6d3b44 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:26.636308 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-7dd5ad15-7393-4cf7-8b17-70e64f6d3b44 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:26.690933 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-7dd5ad15-7393-4cf7-8b17-70e64f6d3b44 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:26.697599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-7dd5ad15-7393-4cf7-8b17-70e64f6d3b44 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1093 microversion: 2.1 time: 0.066257 Jul 25 19:39:26.698153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 674/1374] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:26 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:27.718933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-84b4c336-c46e-499c-9c4b-78690bbb77cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:27.719551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-84b4c336-c46e-499c-9c4b-78690bbb77cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:27.734319 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40738. Jul 25 19:39:27.779153 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-84b4c336-c46e-499c-9c4b-78690bbb77cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:27.786618 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-84b4c336-c46e-499c-9c4b-78690bbb77cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1093 microversion: 2.1 time: 0.071940 Jul 25 19:39:27.787169 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 701/1375] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:27 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:28.807475 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8277c801-c951-4fe6-91f8-3309c359aa53 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:28.808073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8277c801-c951-4fe6-91f8-3309c359aa53 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:28.862546 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8277c801-c951-4fe6-91f8-3309c359aa53 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:28.869312 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8277c801-c951-4fe6-91f8-3309c359aa53 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1093 microversion: 2.1 time: 0.065710 Jul 25 19:39:28.869875 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 675/1376] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:28 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:29.890718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:29.891389 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:29.899679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:29.900195 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:29.900878 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:29.901306 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:29.963646 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:29.971959 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-b8664bf3-b351-4b97-9dc9-28b45b02a35a tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1143 microversion: 2.1 time: 0.085703 Jul 25 19:39:29.972524 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 702/1377] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:29 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:30.993218 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:30.993950 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:31.000689 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:31.001105 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:31.001844 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:31.002356 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:31.067737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:31.075348 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-18ca219f-4280-417c-ba08-16bfdd3e0388 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1191 microversion: 2.1 time: 0.086066 Jul 25 19:39:31.075910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 676/1378] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:30 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:32.097118 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:32.097843 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:32.104751 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:32.105304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:32.106147 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:32.106666 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:32.381094 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:32.388858 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-f087e7a7-c59f-4cea-baef-b7e5124c84a9 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1277 microversion: 2.1 time: 0.296095 Jul 25 19:39:32.400258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 703/1379] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:32 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:33.324130 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-499f08f9-221c-4148-8d3a-46007de8a6f7 req-4802a596-32b3-42c8-aa50-e711f1679963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b2241b-60a1-446d-ab50-375e16860d91", "tag": "dfc66946-5bb4-4747-8461-4425840ccf27"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:39:33.336339 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-499f08f9-221c-4148-8d3a-46007de8a6f7 req-4802a596-32b3-42c8-aa50-e711f1679963 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:33.337242 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-499f08f9-221c-4148-8d3a-46007de8a6f7 req-4802a596-32b3-42c8-aa50-e711f1679963 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:33.350704 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-499f08f9-221c-4148-8d3a-46007de8a6f7 req-4802a596-32b3-42c8-aa50-e711f1679963 service nova] Creating event network-changed:dfc66946-5bb4-4747-8461-4425840ccf27 for instance 42b2241b-60a1-446d-ab50-375e16860d91 on hv-cinder-82002 Jul 25 19:39:33.356137 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-499f08f9-221c-4148-8d3a-46007de8a6f7 req-4802a596-32b3-42c8-aa50-e711f1679963 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103340 Jul 25 19:39:33.356737 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 677/1380] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:33.412112 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:33.412725 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:33.424089 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:33.425245 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:33.426234 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:33.426701 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:33.636795 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:33.645045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-189da7d8-6804-4f27-9c67-6a58eb2d2cf5 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.237856 Jul 25 19:39:33.645604 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 704/1381] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:33 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:34.666886 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:34.667586 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:34.669534 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=2 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:34.675910 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:34.676357 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:34.677125 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:34.677555 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:34.817774 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:34.825369 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-9cf9d920-a82a-4537-acf7-05626b706341 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.162767 Jul 25 19:39:34.825927 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 678/1382] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:34 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:35.846739 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:35.847400 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:35.853791 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:35.854231 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:35.855010 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:35.855436 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:35.988551 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:35.996114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-3728815c-5a60-4202-8bd8-9212ee2bd00f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.153314 Jul 25 19:39:35.996680 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 705/1383] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:35 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:36.122090 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:39:36.122309 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:39:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:39:37.017514 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:37.018207 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:37.025548 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:37.025988 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:37.026778 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:37.027208 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:37.168119 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:37.175699 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-907f8b0c-75c9-4c30-8ab7-63c7669ce07c tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.162149 Jul 25 19:39:37.176272 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 679/1384] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:37 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:38.196528 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:38.197129 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:38.199407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell0:SELECT=4 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:38.204473 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:38.204970 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:38.205747 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:38.206184 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:38.345045 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:38.352867 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2198bb3b-31f5-4646-a3a0-e85126a30b7f tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.160165 Jul 25 19:39:38.353440 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 706/1385] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:38 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:39.375645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:39.376305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:39.379301 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell0:SELECT=10 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:39:39.384654 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:39.385106 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:39.385867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:39.386300 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:39.523148 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:39.530650 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-77e1d0cb-6c4c-4336-9530-9c9c466c2277 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.159442 Jul 25 19:39:39.531214 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 680/1386] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:39 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:40.556541 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:40.557148 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:40.563703 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:40.564139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:40.565441 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:40.565906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:40.696059 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:40.704040 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-260eb7c9-409c-4654-8276-1c6f60efbf88 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.151223 Jul 25 19:39:40.704631 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 707/1387] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:40 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:41.728754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:41.729449 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:41.735765 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:41.736199 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:41.737599 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:41.738032 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:41.876640 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:41.884253 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0c8a5231-db03-4276-8a4b-ba7b52b4deae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.159363 Jul 25 19:39:41.884803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 681/1388] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:41 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:42.905784 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:42.906410 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:42.913517 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:42.913966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:42.914766 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:42.915206 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:43.065679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:43.073458 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1b2e6033-310d-4a05-b819-ba6ac93fc979 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.171599 Jul 25 19:39:43.076116 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 708/1389] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:42 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:44.095492 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:44.096941 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:44.103350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:44.103803 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:44.104575 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:44.105013 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:44.239424 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:44.246871 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-0f422dcb-72cb-4ad3-b9a4-8ff5d3cc380b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.155554 Jul 25 19:39:44.247538 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 682/1390] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:44 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:39:45.268025 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:45.268672 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:45.275776 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:45.276214 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:45.276963 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:45.277391 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:45.413216 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:45.421007 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-0b9c5588-d934-43cd-96d7-f81e6754b3f4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.156767 Jul 25 19:39:45.421926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 709/1391] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:45 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:45.715872 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [req-21107c4a-aff3-49ed-80c9-2a89942facaf req-12db705f-2e93-4f57-9cb3-b3463d773174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b2241b-60a1-446d-ab50-375e16860d91", "name": "network-vif-plugged", "status": "completed", "tag": "dfc66946-5bb4-4747-8461-4425840ccf27"}]} {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:39:45.726156 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-21107c4a-aff3-49ed-80c9-2a89942facaf req-12db705f-2e93-4f57-9cb3-b3463d773174 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:45.726638 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [req-21107c4a-aff3-49ed-80c9-2a89942facaf req-12db705f-2e93-4f57-9cb3-b3463d773174 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:45.738143 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.compute.server_external_events [req-21107c4a-aff3-49ed-80c9-2a89942facaf req-12db705f-2e93-4f57-9cb3-b3463d773174 service nova] Creating event network-vif-plugged:dfc66946-5bb4-4747-8461-4425840ccf27 for instance 42b2241b-60a1-446d-ab50-375e16860d91 on hv-cinder-82002 Jul 25 19:39:45.743277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [req-21107c4a-aff3-49ed-80c9-2a89942facaf req-12db705f-2e93-4f57-9cb3-b3463d773174 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083730 Jul 25 19:39:45.743878 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 683/1392] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:39:46.445032 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:46.445654 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:46.454304 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:46.455000 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:46.456679 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:46.457335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:46.605773 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:46.613619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-1f8849f3-5b42-464b-9c22-f59d5119e4fb tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.174286 Jul 25 19:39:46.614187 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 710/1393] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:46 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:47.636030 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:47.636754 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:47.642959 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:47.643400 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:47.644153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:47.644678 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:47.781952 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:47.790503 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-a9309494-49c9-4545-923b-207954bb2a78 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1265 microversion: 2.1 time: 0.159085 Jul 25 19:39:47.791073 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 684/1394] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:47 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:48.811744 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:48.812345 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:48.819102 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:48.819555 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:48.820329 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:48.820774 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:48.969714 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:48.978449 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-db7150b3-e9a3-4da9-b309-690060f56b7d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1452 microversion: 2.1 time: 0.170452 Jul 25 19:39:48.978939 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 711/1395] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:48 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:48.999025 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:39:48.999632 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:39:49.006170 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:49.006645 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:49.007402 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:49.007831 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:49.144152 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:39:49.152071 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-139cd860-e647-4f6b-8bd2-e4932684b382 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1452 microversion: 2.1 time: 0.156973 Jul 25 19:39:49.152644 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 685/1396] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:39:48 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:39:51.126139 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-51725535-d758-4325-8fb4-2cb922ae8938 req-0a8b068c-3e6a-47f5-b80d-7d6b325c5f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b2241b-60a1-446d-ab50-375e16860d91", "tag": "dfc66946-5bb4-4747-8461-4425840ccf27"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:39:51.137736 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-51725535-d758-4325-8fb4-2cb922ae8938 req-0a8b068c-3e6a-47f5-b80d-7d6b325c5f01 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:39:51.138183 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-51725535-d758-4325-8fb4-2cb922ae8938 req-0a8b068c-3e6a-47f5-b80d-7d6b325c5f01 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:39:51.155485 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-51725535-d758-4325-8fb4-2cb922ae8938 req-0a8b068c-3e6a-47f5-b80d-7d6b325c5f01 service nova] Creating event network-changed:dfc66946-5bb4-4747-8461-4425840ccf27 for instance 42b2241b-60a1-446d-ab50-375e16860d91 on hv-cinder-82002 Jul 25 19:39:51.156793 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-51725535-d758-4325-8fb4-2cb922ae8938 req-0a8b068c-3e6a-47f5-b80d-7d6b325c5f01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034394 Jul 25 19:39:51.157926 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 712/1397] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:40:21.506513 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:40:21.507153 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:41:41.764258 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 19:41:41.767537 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:41.768035 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:41.768812 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_api:SELECT=30 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:41.769570 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG dbcounter [-] [125166] Writing DB stats nova_cell1:SELECT=62 {{(pid=125166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:41.773967 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-62c0acf2-c785-4f40-a853-8c90c3e43060 req-7679a771-499c-47e8-81d7-869700eec466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b2241b-60a1-446d-ab50-375e16860d91", "tag": "dfc66946-5bb4-4747-8461-4425840ccf27"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:41:41.780623 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:41.781277 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG dbcounter [-] [125167] Writing DB stats nova_cell1:SELECT=54 {{(pid=125167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:41:41.786782 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:41.787235 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:41.788060 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:41.788493 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:41.790396 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-62c0acf2-c785-4f40-a853-8c90c3e43060 req-7679a771-499c-47e8-81d7-869700eec466 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:41.792619 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-62c0acf2-c785-4f40-a853-8c90c3e43060 req-7679a771-499c-47e8-81d7-869700eec466 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:41.805214 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-62c0acf2-c785-4f40-a853-8c90c3e43060 req-7679a771-499c-47e8-81d7-869700eec466 service nova] Creating event network-changed:dfc66946-5bb4-4747-8461-4425840ccf27 for instance 42b2241b-60a1-446d-ab50-375e16860d91 on hv-cinder-82002 Jul 25 19:41:41.811241 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-62c0acf2-c785-4f40-a853-8c90c3e43060 req-7679a771-499c-47e8-81d7-869700eec466 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049070 Jul 25 19:41:41.812109 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 713/1398] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:41.819919 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:41:42.162731 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-899aac70-2097-4449-a54e-75846033f93b tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "DELETE /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 204 len: 0 microversion: 2.1 time: 0.399873 Jul 25 19:41:42.163702 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 686/1399] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:41:41 2022] DELETE /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 19:41:42.174162 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:42.175042 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:42.184424 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:42.184664 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:42.185407 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:42.185839 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:42.595716 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:42.604240 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-2359bf23-a3a5-4924-9310-2e72b1e21733 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1577 microversion: 2.1 time: 0.435218 Jul 25 19:41:42.604801 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 714/1400] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:42 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1577 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:43.627796 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:43.628521 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:43.635856 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:43.636305 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:43.637074 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:43.637511 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:43.772694 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:43.780633 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-3543db2c-4b4e-48a0-af8a-f817a8de9fdf tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1458 microversion: 2.1 time: 0.157089 Jul 25 19:41:43.781227 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 687/1401] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:43 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:44.355093 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-59ad800d-416c-40c1-81db-d412fa1f6a27 req-d755374d-3cbc-41a6-9943-9f1f81276247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b2241b-60a1-446d-ab50-375e16860d91", "name": "network-vif-deleted", "tag": "dfc66946-5bb4-4747-8461-4425840ccf27"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:41:44.366706 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-59ad800d-416c-40c1-81db-d412fa1f6a27 req-d755374d-3cbc-41a6-9943-9f1f81276247 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:44.367081 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-59ad800d-416c-40c1-81db-d412fa1f6a27 req-d755374d-3cbc-41a6-9943-9f1f81276247 service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:44.379663 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d3f0212-584d-4d44-8518-f9b3ec507dde] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 40862. Jul 25 19:41:44.381686 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-59ad800d-416c-40c1-81db-d412fa1f6a27 req-d755374d-3cbc-41a6-9943-9f1f81276247 service nova] Creating event network-vif-deleted:dfc66946-5bb4-4747-8461-4425840ccf27 for instance 42b2241b-60a1-446d-ab50-375e16860d91 on hv-cinder-82002 Jul 25 19:41:44.386605 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-59ad800d-416c-40c1-81db-d412fa1f6a27 req-d755374d-3cbc-41a6-9943-9f1f81276247 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Jul 25 19:41:44.395244 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 715/1402] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:44.802273 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:44.802909 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:44.810223 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:44.810695 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:44.811458 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:44.811880 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:44.875154 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:44.882867 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-8a4a52b3-3eb7-46b3-81f4-ae8abc1d0ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 200 len: 1224 microversion: 2.1 time: 0.084497 Jul 25 19:41:44.889104 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 688/1403] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:44 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:45.905393 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:45.906015 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: 42b2241b-60a1-446d-ab50-375e16860d91] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:45.912597 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:45.913050 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:45.913825 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:45.915289 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:45.928966 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] HTTP exception thrown: Instance 42b2241b-60a1-446d-ab50-375e16860d91 could not be found. Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Request method failure captured: Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 HTTP/1.1 Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3vARaTeynYHjHjFCXe7Kbs2MEtLiluWCBtcdRZo3l7XR9td3FzPRWFQGshNXfvofr54nuQRalhja-0oyPrVmAsYcVezJt-1wKzdGERY1VCgunkpHtsG4WZgQO9M3ZBU1OWTRVRKGRtTqZrSaLNh9OyKsL_dOtDsOGfvP-7RtTBiifFI Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:41:45.930690 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_03519fbb6e4c42098f809f799c77f884", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 31413326a6de469e9d657d9ef3037cbe Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance 42b2241b-60a1-446d-ab50-375e16860d91 could not be found. Jul 25 19:41:45.932587 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': '42b2241b-60a1-446d-ab50-375e16860d91'} Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b2241b-60a1-446d-ab50-375e16860d91 could not be found. Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:41:45.933640 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b2241b-60a1-446d-ab50-375e16860d91 could not be found. Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b2241b-60a1-446d-ab50-375e16860d91 could not be found. Jul 25 19:41:45.935384 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:45.936906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Returning 404 to user: Instance 42b2241b-60a1-446d-ab50-375e16860d91 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:41:45.936906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e9d738fc-1757-458b-89da-46966f59fe9d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91" status: 404 len: 111 microversion: 2.1 time: 0.031669 Jul 25 19:41:45.936906 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 716/1404] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:45 2022] GET /compute/v2.1/servers/42b2241b-60a1-446d-ab50-375e16860d91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 19:41:49.555107 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:49.556292 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:49.557934 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-3a9e6d33-1ab0-47ea-a4ec-9b69c9fefadc req-ab10c511-1fcf-4e59-abcf-24a00fbbfcbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36cbe37-058f-4dc2-903f-7450b95e0c19", "tag": "08532af4-2657-41b3-95af-eafa559bdf33"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:41:49.563352 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:49.563882 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:49.568102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:49.568102 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:49.569159 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-3a9e6d33-1ab0-47ea-a4ec-9b69c9fefadc req-ab10c511-1fcf-4e59-abcf-24a00fbbfcbc service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:49.569657 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-3a9e6d33-1ab0-47ea-a4ec-9b69c9fefadc req-ab10c511-1fcf-4e59-abcf-24a00fbbfcbc service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:49.581756 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-3a9e6d33-1ab0-47ea-a4ec-9b69c9fefadc req-ab10c511-1fcf-4e59-abcf-24a00fbbfcbc service nova] Creating event network-changed:08532af4-2657-41b3-95af-eafa559bdf33 for instance d36cbe37-058f-4dc2-903f-7450b95e0c19 on hv-cinder-82002 Jul 25 19:41:49.588100 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-3a9e6d33-1ab0-47ea-a4ec-9b69c9fefadc req-ab10c511-1fcf-4e59-abcf-24a00fbbfcbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034865 Jul 25 19:41:49.589065 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 717/1405] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:49.596270 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Going to try to terminate instance {{(pid=125167) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 19:41:49.889250 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e884272a-f9f9-493b-9841-c63703a75e67 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 204 len: 0 microversion: 2.1 time: 0.337926 Jul 25 19:41:49.893283 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 689/1406] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:41:49 2022] DELETE /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 19:41:49.898829 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:49.899630 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:49.905993 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:49.906466 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:49.907446 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:49.908082 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:50.048792 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.policy [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125166) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:50.066038 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-ddebbef6-2971-4ea3-a5a9-f15c8b61a257 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1577 microversion: 2.1 time: 0.171350 Jul 25 19:41:50.066661 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 718/1407] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:49 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:51.089864 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:51.090608 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:51.097580 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:51.098036 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:51.098924 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:51.099350 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:51.242206 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:51.254443 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-43f0141e-c84c-447b-b363-5b476e9faaae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1577 microversion: 2.1 time: 0.165443 Jul 25 19:41:51.254443 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 690/1408] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:51 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:41:52.050899 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [req-f7e03463-6e12-4337-b3f1-4fcbc0fa8f44 req-cc89db6b-2247-4b80-b3ff-f908d9df19cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36cbe37-058f-4dc2-903f-7450b95e0c19", "name": "network-vif-deleted", "tag": "08532af4-2657-41b3-95af-eafa559bdf33"}]} {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:41:52.061263 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-f7e03463-6e12-4337-b3f1-4fcbc0fa8f44 req-cc89db6b-2247-4b80-b3ff-f908d9df19cb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:52.061806 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [req-f7e03463-6e12-4337-b3f1-4fcbc0fa8f44 req-cc89db6b-2247-4b80-b3ff-f908d9df19cb service nova] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:52.073995 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.compute.server_external_events [req-f7e03463-6e12-4337-b3f1-4fcbc0fa8f44 req-cc89db6b-2247-4b80-b3ff-f908d9df19cb service nova] Creating event network-vif-deleted:08532af4-2657-41b3-95af-eafa559bdf33 for instance d36cbe37-058f-4dc2-903f-7450b95e0c19 on hv-cinder-82002 Jul 25 19:41:52.078994 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [req-f7e03463-6e12-4337-b3f1-4fcbc0fa8f44 req-cc89db6b-2247-4b80-b3ff-f908d9df19cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 Jul 25 19:41:52.079772 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 719/1409] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Jul 25 19:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:41:52.272346 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:52.272947 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:52.280123 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:52.281212 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:52.281567 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:52.281898 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:52.358853 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.policy [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31413326a6de469e9d657d9ef3037cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03519fbb6e4c42098f809f799c77f884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125167) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 19:41:52.366604 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-e258a119-6ea8-47cf-acb1-425f41432ada tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 200 len: 1224 microversion: 2.1 time: 0.098112 Jul 25 19:41:52.367698 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 691/1410] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:52 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:41:53.388857 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:53.389462 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d36cbe37-058f-4dc2-903f-7450b95e0c19] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:53.396863 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:53.397311 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:53.398114 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:53.398574 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:53.413015 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] HTTP exception thrown: Instance d36cbe37-058f-4dc2-903f-7450b95e0c19 could not be found. Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Request method failure captured: Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 HTTP/1.1 Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3vARaTeynYHjHjFCXe7Kbs2MEtLiluWCBtcdRZo3l7XR9td3FzPRWFQGshNXfvofr54nuQRalhja-0oyPrVmAsYcVezJt-1wKzdGERY1VCgunkpHtsG4WZgQO9M3ZBU1OWTRVRKGRtTqZrSaLNh9OyKsL_dOtDsOGfvP-7RtTBiifFI Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:41:53.415357 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_03519fbb6e4c42098f809f799c77f884", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 31413326a6de469e9d657d9ef3037cbe Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance d36cbe37-058f-4dc2-903f-7450b95e0c19 could not be found. Jul 25 19:41:53.417870 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'd36cbe37-058f-4dc2-903f-7450b95e0c19'} Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d36cbe37-058f-4dc2-903f-7450b95e0c19 could not be found. Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:41:53.419085 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d36cbe37-058f-4dc2-903f-7450b95e0c19 could not be found. Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d36cbe37-058f-4dc2-903f-7450b95e0c19 could not be found. Jul 25 19:41:53.420923 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.422554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Returning 404 to user: Instance d36cbe37-058f-4dc2-903f-7450b95e0c19 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:41:53.422554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-5ffb986b-572f-434e-b41d-fdd4dd4326ae tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19" status: 404 len: 111 microversion: 2.1 time: 0.033274 Jul 25 19:41:53.422554 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 720/1411] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:53 2022] GET /compute/v2.1/servers/d36cbe37-058f-4dc2-903f-7450b95e0c19 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:41:53.938120 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:53.938652 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.compute.api [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125167) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:53.945083 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:53.945530 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:53.946267 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:53.946718 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG oslo_concurrency.lockutils [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:53.960700 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.wsgi [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] HTTP exception thrown: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Request method failure captured: Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: request: DELETE /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 HTTP/1.1 Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept: application/json Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Accept-Encoding: identity Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Connection: close Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Length: 0 Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Content-Type: application/json Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Host: 10.222.0.17 Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Openstack-System-Scope: None Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: User-Agent: python-urllib3/1.26.10 Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Auth-Token: gAAAAABi3vARaTeynYHjHjFCXe7Kbs2MEtLiluWCBtcdRZo3l7XR9td3FzPRWFQGshNXfvofr54nuQRalhja-0oyPrVmAsYcVezJt-1wKzdGERY1VCgunkpHtsG4WZgQO9M3ZBU1OWTRVRKGRtTqZrSaLNh9OyKsL_dOtDsOGfvP-7RtTBiifFI Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Id: None Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Domain-Name: None Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Identity-Status: Confirmed Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Is-Admin-Project: True Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Id: default Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Domain-Name: Default Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Project-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Role: reader,member Jul 25 19:41:53.962445 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Roles: reader,member Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_03519fbb6e4c42098f809f799c77f884", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Id: default Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Domain-Name: Default Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Id: 31413326a6de469e9d657d9ef3037cbe Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: X-User-Name: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: method: > Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: exception: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:53.966062 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: action_args: {'id': 'd93e2b8b-7ee2-45b5-a777-ccd004626b28'} Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:41:53.967197 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:53.969085 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: ERROR nova.api.openstack.wsgi Jul 25 19:41:53.971026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Returning 404 to user: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. {{(pid=125167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:41:53.971026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-783c0661-73d7-4c08-9bd0-37120103f05d tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 404 len: 111 microversion: 2.1 time: 0.030410 Jul 25 19:41:53.971026 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 692/1412] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Jul 25 19:41:53 2022] DELETE /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:41:53.975377 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '>' {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:53.975986 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.compute.api [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] [instance: d93e2b8b-7ee2-45b5-a777-ccd004626b28] Fetching instance by UUID {{(pid=125166) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 19:41:53.983335 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:53.983783 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:53.984558 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:41:53.985035 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG oslo_concurrency.lockutils [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Lock "04f7c03e-eb8a-4b91-bf46-eb25d497e920" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:41:53.999718 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.wsgi [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] HTTP exception thrown: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Request method failure captured: Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: request: GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 HTTP/1.1 Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept: application/json Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Accept-Encoding: identity Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Connection: close Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Length: 0 Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Content-Type: application/json Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Host: 10.222.0.17 Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Openstack-System-Scope: None Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: User-Agent: python-urllib3/1.26.10 Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Auth-Token: gAAAAABi3vARaTeynYHjHjFCXe7Kbs2MEtLiluWCBtcdRZo3l7XR9td3FzPRWFQGshNXfvofr54nuQRalhja-0oyPrVmAsYcVezJt-1wKzdGERY1VCgunkpHtsG4WZgQO9M3ZBU1OWTRVRKGRtTqZrSaLNh9OyKsL_dOtDsOGfvP-7RtTBiifFI Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Id: None Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Domain-Name: None Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Identity-Status: Confirmed Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Is-Admin-Project: True Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Id: default Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Domain-Name: Default Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Project-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Role: reader,member Jul 25 19:41:54.001242 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Roles: reader,member Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/03519fbb6e4c42098f809f799c77f884"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_03519fbb6e4c42098f809f799c77f884", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}] Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Id: 03519fbb6e4c42098f809f799c77f884 Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090509185 Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Id: default Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Domain-Name: Default Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Id: 31413326a6de469e9d657d9ef3037cbe Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: X-User-Name: tempest-TestVolumeBootPattern-1090509185-project Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: method: > Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: exception: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:54.003136 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: action_args: {'id': 'd93e2b8b-7ee2-45b5-a777-ccd004626b28'} Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: {{(pid=125166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:41:54.004279 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. Jul 25 19:41:54.005880 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: ERROR nova.api.openstack.wsgi Jul 25 19:41:54.007479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: DEBUG nova.api.openstack.wsgi [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Returning 404 to user: Instance d93e2b8b-7ee2-45b5-a777-ccd004626b28 could not be found. {{(pid=125166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:41:54.007479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO nova.api.openstack.requestlog [None req-e3799298-691c-4d92-8f58-219370f812cd tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28" status: 404 len: 111 microversion: 2.1 time: 0.031462 Jul 25 19:41:54.007479 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: [pid: 125166|app: 0|req: 721/1413] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Jul 25 19:41:53 2022] GET /compute/v2.1/servers/d93e2b8b-7ee2-45b5-a777-ccd004626b28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 19:41:55.538925 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: DEBUG nova.api.openstack.wsgi [None req-831e34c6-fdf9-4773-a244-7da7dc6087a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] Calling method '.version_select at 0x7fd8e684c5e0>' {{(pid=125167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:41:55.662358 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO nova.api.openstack.requestlog [None req-831e34c6-fdf9-4773-a244-7da7dc6087a4 tempest-TestVolumeBootPattern-1090509185 tempest-TestVolumeBootPattern-1090509185-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-509470960" status: 202 len: 0 microversion: 2.1 time: 0.130611 Jul 25 19:41:55.663315 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: [pid: 125167|app: 0|req: 693/1414] 10.222.0.17 () {58 vars in 1260 bytes} [Mon Jul 25 19:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-509470960 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 19:42:44.900321 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:42:44.900953 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:42:56.131228 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:42:56.131933 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:42:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:44:32.293072 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:44:32.293725 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:44:55.825416 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:44:55.826108 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:45:00.348078 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:45:00.348647 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:46:04.908992 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:46:04.909842 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:46:16.139465 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:46:16.140117 dv-cinder-820027-16-iscsi devstack@n-api.service[125166]: Mon Jul 25 19:46:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:47:01.518406 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:47:01.519011 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 19:47:52.302705 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 19:47:52.303409 dv-cinder-820027-16-iscsi devstack@n-api.service[125167]: Mon Jul 25 19:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!